Rising interest rates are leading to diminished demand for non-QM whole loans saddled with lower rates. Longer term, industry participants remain optimistic.