Mortgage lenders large and small have indicated they plan to stay away from making mortgages that do not fit into either the “safe harbor” or the “rebuttable presumption” QM boxes.