The heads of mortgage industry trade groups are frustrated that the federal government is crowding out non-agency market participants.