Some non-agency participants have called for an immediate return to conforming loan limits of $417,000, which were in place in 2008 before Congress established “emergency” loan limits for high-cost areas.