SFA leader says ending GSE conservatorships would lead to unsustainable credit downgrades for Fannie and Freddie.