The Federal Housing Finance Agency said other agencies are already responsible for enforcing fair lending and fair housing laws. However, critics argued that the administration has been steadily eviscerating the enforcement arms of those agencies as well.