Impac Mortgage and Western Asset Mortgage Capital took losses in the second quarter as the non-QM market faltered.