When interest rates on mortgages rise, young and middle-income consumers fall away from the mortgage market, according to a working paper from FHFA.