The Department of Housing and Urban Development has been flooded with mostly critical letters suggesting changes to its proposal to significantly hike the affordable housing goals for Fannie Mae and Freddie Mac, but observers question how much the agency will bend.