Compared to the same month a year ago, both sectors have trimmed workers: mortgage bankers by 5,300, brokers by 3,800.