Automated Model Selection (AMS) on Finite Mixture: a New Perspective for Data Modeling

Jin-wen MA
DOI: https://doi.org/10.3969/j.issn.1005-3085.2007.04.001
2007-01-01
Abstract:In data modeling and analysis, finite mixture is widely used.However, the selection of number of components in the mixture for a sample data set is still a rather difficult task.In order to overcome it, many criteria have been proposed to determine the best number of components or clusters in the sample data.Since the number of components is just a scale of the mixture model, its selection is usually referred to as model selection.Recently.a novel Automated Model Selection(AMS)learning mechanism for finite mixture modeling, especially for Gaussian mixture modeling, has been developed such that model selection can be made automatically during parameter learning on the sample data, which provide a new perspective for data modeling and analysis.In the current paper, we survey some main results of AMS on Gaussian mixture or general finite mixture.First, we summarize some AMS learning algorithms on Gaussian or finite mixture based on the Bayesian Ying-Yang (BYY)harmony learning principle.We then describe an entropy penalized AMS learning algorithm on Gaussian mixture.Finally, we present some typical practical applications of these AMS learning algorithms.
What problem does this paper attempt to address?