The conservator of Fannie and Freddie argued that the testimonies of two former FHFA directors were irrelevant because they were not at the agency when the Treasury Department agreed to the net worth sweep.