It depends on wealth,class and kingdom, usually. IN my land, the homes are mostly small ones of stone and wood, although I, as king, live in a large castle of stone. The castle's walls also surround and protect the rest of the city.
There are other kingdoms, though, where the cultures differ. I know only a little, what stories have filtered back to us, but sometimes they are strange. The same materials, usually, but different constuction or design.