A number of groups representing lenders and consumer advocates said the CFPB should abandon an effort to extend the QM patch beyond July 1. The regulator also faces hurdles involving the GSEs and federal rulemaking requirements.