is our economy really so much dependent on the housing market?

there are so much predictions around saying that the cooling off of the housing market will inevitably bring in a recession. I thought the U.S is big enough of a country and has an economy diverse enough to not crumble just because the real esate agents are not making a killing any more.