The FHFA partially agreed with the IG's first recommendation and flatly rejected the second.

Company CEO Brian Hale downplayed the news of an offering book, noting that it hired an investment banker because over the past 12 months Stearns has been approached by “a number of interested investors.”

The loan is available in California, Florida, Hawaii and New Jersey, and is slated to be expanded to other states.

Although there appears to be strong interest these days in mortgage banking firms, the outlook isn’t particularly bright for commercial banks.

Two other major contributors to the deal, George Mason Mortgage and American Pacific Mortgage, are retail-only shops.

AmeriSave, a nonbank, has not been without controversy itself.

David Stevens, who led the FHA for part of the financial crisis, recalled difficult times dealing with policymakers and appropriators.

“The conservatorships are a huge barrier to entry for private capital,” said former FHFA Acting Director Edward DeMarco.

The Mortgage Bankers Association wants the FHFA to push Fannie and Freddie to go easy on mortgage buybacks.

The White House meeting is expected to touch on key lender issues, including credit overlays, government enforcement actions, regulatory burden and risk-based versus FHA pricing.