Entropy Penalized Automated Model Selection On Gaussian Mixture

Jinwen Ma,Taijun Wang
DOI: https://doi.org/10.1142/S0218001404003812
IF: 1.261
2004-01-01
International Journal of Pattern Recognition and Artificial Intelligence
Abstract:Gaussian mixture modeling is a powerful approach for data analysis and the determination of the number of Gaussians, or clusters, is actually the problem of Gaussian mixture model selection which has been investigated from several respects. This paper proposes a new kind of automated model selection algorithm for Gaussian mixture modeling via an entropy penalized maximum-likelihood estimation. It is demonstrated by the experiments that the proposed algorithm can make model selection automatically during the parameter estimation, with the mixing proportions of the extra Gaussians attenuating to zero. As compared with the BYY automated model selection algorithms, it converges more stably and accurately as the number of samples becomes large.
What problem does this paper attempt to address?