The 16, which include the Mortgage Bankers Association and American Bankers Association, want the CFPB to deepen its engagement using industry forums.

“Law enforcement has been on a bit of a run with settlements and enforcement," said Jim Parrott, a former Obama administration point man on housing.

The FHFA partially agreed with the IG's first recommendation and flatly rejected the second.

Although there appears to be strong interest these days in mortgage banking firms, the outlook isn’t particularly bright for commercial banks.

David Stevens, who led the FHA for part of the financial crisis, recalled difficult times dealing with policymakers and appropriators.

“The conservatorships are a huge barrier to entry for private capital,” said former FHFA Acting Director Edward DeMarco.

The Mortgage Bankers Association wants the FHFA to push Fannie and Freddie to go easy on mortgage buybacks.

The White House meeting is expected to touch on key lender issues, including credit overlays, government enforcement actions, regulatory burden and risk-based versus FHA pricing.

The Finance Agency filed suit against HSBC and 17 other firms in 2011. The two remaining defendants in the cases include Nomura Holdings and the Royal Bank of Scotland Group.

Delta Prime Refinance was the business trade name used by Intermundo.