We analyze the classical problem of the stochastic dynamics of a particle confined in a periodic potential, through the so called Il'in and Khasminskii model, with a novel semi-analytical approach. Our approach gives access to the transient and the asymptotic dynamics in all damping regimes, which are difficult to investigate in the usual Brownian model. We show that the crossover from the overdamped to the underdamped regime is associated with the loss of a typical time scale and of a typical length scale, as signaled by the divergence of the probability distribution of a certain dynamical event. In the underdamped regime, normal diffusion coexists with a non Gaussian displacement probability distribution for a long transient, as ...