We develop an economic geography model where mobile skilled workers choose to either work in a production sector or to become part of an unproductive elite. The elite sets income tax rates to maximize its own welfare by extracting rents, thereby influencing the spatial structure of the economy and changing the available range of consumption goods. We show that either unskilled labour mobility, or rent-seeking behaviour, or both, are likely to favour the occurence of agglomeration and of urban primacy. In equilibrium, the elite may tax the unskilled workers but does not tax the skilled workers, and there are rural-urban transfers towards the agglomeration. The size of the elite and the magnitude of the tax burden that falls on the unskilled ...