Consumers are feeling little optimism for the 2024 housing market as affordability concerns continue to push would-be buyers away from purchasing a home next year.