With mortgage rates hovering between 6.5% and 7.5%, affordability is the sector's biggest hurdle.