â Should Fannie Mae and Freddie Mac be barred by legislation from participating in the non-conforming mortgage market? The top Federal Reserve Board official apparently thinks so. “It ought, in my judgment, at least be made clear within a regulatory structure – which you’re about to set up I trust – that some definition of what constitutes conforming and non-conforming is made fairly clear and an awareness of the fact that we have a