Congress should permit the conforming mortgage loan limits for Fannie Mae, Freddie Mac and the FHA to remain lower as attempts to restore the higher limit could do the mortgage market more harm than good, an expert says.The “emergency” high cost conforming loan limits enacted in 2008 for the GSEs and the FHA expired on Sept. 30, dropping the limit to $625,500 from $729,750.