The mortgage industry wants Ginnie Mae to withdraw the pandemic-related pooling restrictions imposed on reperforming loans.