The nonabelian Jacobian J(X; L, d) of a smooth projective surface X is inspired by the classical theory of Jacobian of curves. It is built as a natural scheme interpolating between the Hilbert scheme X [d] of subschemes of length d of X and the stack M X (2, L, d) of torsion free sheaves of rank 2 on X having the determinant O X (L) and the second Chern class (= number) d. It relates to such influential ideas as variations of Hodge structures, period maps, nonabelian Hodge theory, Homological mirror symmetry, perverse sheaves, geometric Langlands program. These relations manifest themselves by the appearance of the following structures on J(X; L, d): a sheaf of reductive Lie algebras (singular) Fano toric varieties whose hyperplane section...