Sato–Tate distributions and Galois endomorphism modules in genus 2

For an abelian surface A over a number field k, we study the limiting distribution of the normalized Euler factors of the L-function of A. This distribution is expected to correspond to taking characteristic polynomials of a uniform random matrix in some closed subgroup of USp(4); this Sato–Tate group may be obtained from the Galois action on any Tate module of A. We show that the Sato–Tate group is limited to a particular list of 55 groups up to conjugacy. We then classify A according to the Galois module structure on the ℝ-algebra generated by endomorphisms of [superscript A][line over Q] (the Galois type), and establish a matching with the classification of Sato–Tate groups; this shows that there are at most 52 groups up to conjugacy which occur as Sato–Tate groups for suitable A and k, of which 34 can occur for k=ℚ. Finally, we present examples of Jacobians of hyperelliptic curves exhibiting each Galois type (over ℚ whenever possible), and observe numerical agreement with the expected Sato–Tate distribution by comparing moment statistics.National Science Foundation (U.S.) (CAREER Grant DMS-0545904)National Science Foundation (U.S.) (Grant DMS-1101343)United States. Defense Advanced Research Projects Agency (Grant HR0011-09-1-0048)NEC Research Support FundIda M. Green FellowshipUniversity of California, San Diego (Warschawski Professorship)National Science Foundation (U.S.) (Grant DMS-1115455