A Kurtosis-Based Dynamic Approach to Gaussian Mixture Modeling

We address the problem of probability density function estimation using a Gaussian mixture model updated with the EM algorithm. To deal with the case of an unknown number of mixing kernels, we define a new measure for Gaussian mixtures, called total kurtosis, which is based on the weighted sample kurtoses of the kernels. This measure provides an indication of how well the Gaussian mixture fits the data. Then we propose a new dynamic algorithm for Gaussian mixture density estimation which monitors the total kurtosis at each step of the EM algorithm in order to decide dynamically on the correct number of kernels and possibly escape from local maxima. We show the potential of our technique in approximating unknown densities through a series of examples with several density estimation problems. Keywords---Probability density function estimation, Gaussian mixture modeling, number of mixing kernels, weighted kurtosis, total kurtosis, EM algorithm. I. Introduction T HE Gaussian mixture mod..