fewer higher ones for sure. As buildings level up, they become more efficient for the spaces they take up, and space on your city map is the hardest resource to come by.
Also only build the ones you are boosted in. Do not bother with the rest. It is much better to then trade for the goods you need (a good fellowship makes this easy, but so can a strong neighbourhood).