Abstract:As an extremely powerful probability model, Gaussian mixture model (GMM) has been widely used in fields of pattern recognition, information processing and data mining. If the number of the Gaussians in the mixture is pre-known, the well-known Expectation-Maximization (EM) algorithm could be used to estimate the parameters in the Gaussian mixture model. However, in many practical applications, the number of the components is not known.Then the Gaussian mixture modeling becomes a compound problem of the determination of number of Gaussian components and the parameter estimation for the mixture, which is rather difficult. In this paper, we propose a split and merge EM (SMEM) algorithm to decide the number of the components, which is referred to the model selection for the mixture. Based on the minimum description length (MDL) criterion, the proposed SMEM algorithm can avoid the local optimum drawback of the usual EM algorithm and determine the number of components in the Gaussian mixture model automatically. By splitting and merging the uncorrect components, the algorithm can converge to the maximization of the MDL criterion function and get a better parameter estimation of the Gaussian mixture with correct number of components in the mixture. It is demonstrated well by the experiments that the proposed split and merge EM algorithm can make both parameter learning and model selection efficiently for Gaussian mixture.

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Gaussian mixture density modeling and decomposition with weighted likelihood

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

A Split and Merge EM Algorithm for Color Image Segmentation

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning

A Dynamic Merge-or-split Learning Algorithm on Gaussian Mixture for Automated Model Selection

Adaptive Learning Algorithm Based on Mixture Gaussian Background

Greedy EM Algorithm for Robust T-Mixture Modeling

An Efficient Greedy EM Algorithm for Gaussian Mixture for Adaptive Model Selection Using the Kurtosis and Skewness Criterion

Unsupervised Learning of Gaussian Mixture Model with Application to Image Segmentation

A Fast Globally Supervised Learning Algorithm for Gaussian Mixture Models

The EM Algorithm for Generalized Exponential Mixture Model

Robust Unsupervised Multi-task and Transfer Learning on Gaussian Mixture Models

Gaussian mixture modelling by exploiting competitive stop EM algorithm

Generalized Competitive Learning of Gaussian Mixture Models

A generalized competitive learning algorithm on gaussian mixture with automatic model selection

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

A Gpu-Accelerated Approximate Algorithm for Incremental Learning of Gaussian Mixture Model

Learning Gaussian mixture model with a maximization-maximization algorithm for image classification