Abstract:As an extremely powerful probability model, Gaussian mixture model (GMM) has been widely used in fields of pattern recognition, information processing and data mining. If the number of the Gaussians in the mixture is pre-known, the well-known Expectation-Maximization (EM) algorithm could be used to estimate the parameters in the Gaussian mixture model. However, in many practical applications, the number of the components is not known.Then the Gaussian mixture modeling becomes a compound problem of the determination of number of Gaussian components and the parameter estimation for the mixture, which is rather difficult. In this paper, we propose a split and merge EM (SMEM) algorithm to decide the number of the components, which is referred to the model selection for the mixture. Based on the minimum description length (MDL) criterion, the proposed SMEM algorithm can avoid the local optimum drawback of the usual EM algorithm and determine the number of components in the Gaussian mixture model automatically. By splitting and merging the uncorrect components, the algorithm can converge to the maximization of the MDL criterion function and get a better parameter estimation of the Gaussian mixture with correct number of components in the mixture. It is demonstrated well by the experiments that the proposed split and merge EM algorithm can make both parameter learning and model selection efficiently for Gaussian mixture.

Model Selection for Gaussian Mixture Models

Model selection of Gaussian mixture process and its application

Entropy Penalized Automated Model Selection On Gaussian Mixture

Gaussian mixture density modeling and decomposition with weighted likelihood

An Effective Model Selection Criterion for Mixtures of Gaussian Processes.

Automatic Model Selection Of The Mixtures Of Gaussian Processes For Regression

A Kurtosis and Skewness Based Criterion for Model Selection on Gaussian Mixture

Automated Model Selection (AMS) on Finite Mixture: a New Perspective for Data Modeling

An Efficient Greedy EM Algorithm for Gaussian Mixture for Adaptive Model Selection Using the Kurtosis and Skewness Criterion

Renyi entropy penalized learning algorithm for Gaussian mixture with automated model selection

Automatic Model Selection Algorithm Based on BYY Harmony Learning for Mixture of Gaussian Process Functional Regressions Models.

A Dynamic Model Selection Algorithm for Mixtures of Gaussian Processes

A gradient entropy regularized likelihood learning algorithm on gaussian mixture with automatic model selection

Model Selection for Exponential Power Mixture Regression Models

A Semi-Supervised Learning Algorithm on Gaussian Mixture with Automatic Model Selection

Full-model estimation for non-parametric multivariate finite mixture models

Model Selection Prediction for the Mixture of Gaussian Processes with RJMCMC

Gaussian Mixture Learning Via Robust Competitive Agglomeration

Learning Gaussian Mixture Models By Structural Risk Minimization

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

Model-based clustering based on sparse finite Gaussian mixtures