While overall agency delinquency rates remained significantly elevated, the number of new loans entering the 30-day late category fell sharply from April to May.