Almost sure convergence of Titterington's recursive estimator for mixture models

Titterington proposed a recursive parameter estimation algorithm for finite mixture models. However, due to the well known problem of singularities and multiple maximum, minimum and saddle points that are possible on the likelihood surfaces, convergence analysis has seldom been made in the past years. In this paper, under mild conditions, we show the global convergence of Titterington's recursive estimator and its MAP variant for mixture models of full regular exponential family.Recursive estimation Incomplete data Mixture model Regular exponential family Almost sure convergence Stochastic approximation