The top mortgage lenders in the servicing business managed to build their portfolios significantly during the first quarter of 2005, despite a slight downturn in new production. According to data collected by Inside Mortgage Finance, an affiliated newsletter, the 30 largest servicers in the business increased their combined portfolios by $235.7 billion during the first three months of the year. At the same time, the Federal Reserve Board reported that outstanding mortgage debt – the…