When the mortgage market gets tough, lenders start outsourcing and many small to-mid-sized firms are now embracing private label mortgage solutions as a way to cut expenses but stay in the lending game. Nevertheless, not all firms are outsourcing because of tight times; some are new entrants. “We didn’t get into the mortgage business based on timing,” said new residential lender John Doyle, senior vice president of community banking operations for Affinity National Bank. “We…