The former financial services executive will lead an agency known for distributing billions in contracts to small businesses.