Would secondary mortgage giant Fannie Mae ever turn away good business from its top lender customers? Yes, if the government-sponsored enterprise is forced to meet affordable housing goals that are unrealistically high, Fannie warns in a recent presentation to the Mortgage Bankers Association.