Hard times have hit the lending side of the residential finance industry. And that may affect the wallets of some executive-owners.