Many banks are beginning to shy away from the product as the Inspector General of the Department of Housing and Urban Development and Justice Department take banks to task for underwriting flaws.