Spontaneous spin-up, i.e., the significant increase of the total angular momentum of a flow that initially has no net angular momentum, is very characteristic for decaying two-dimensional turbulence in square domains bounded by rigid no-slip walls. In contrast, spontaneous spin-up is virtually absent for such flows in a circular domain with a no-slip boundary. In order to acquire an understanding of this strikingly different behavior observed on the square and the circle, we consider a set of elliptic geometries with a gradual increase of the eccentricity. It is shown that a variation of the eccentricity can be used as a control parameter to tune the relative contribution of the pressure and viscous stresses in the angular momentum balance....