Mortgage prepayment speeds were already running at high levels when the refinance boom hit late in 2002, and the strain on profitability was evident for all size lenders. Matrix Bancorp, a $1.7 billion bank based in Denver, this week said it has seen enough of servicing volatility and will begin selling its way out of the market.