Abstract:The Gaussian mixture model is widely applied in the fields of data analysis and information processing. Recently, its parameter learning with adaptive model selection, i.e., the adaptive selection of number of Gaussian distributions in the mixture for a given sample dataset, has become an attracting and interesting topic. In this paper, we propose a dynamically regularized maximum likelihood learning (DRMLL) algorithm for Gaussian mixtures with adaptive model selection. The basic idea is that the Bayesian Ying-Yang (BYY) harmony learning is interpreted as the maximum likelihood learning regularized by the average Shannon entropy of the posterior probability per sample scaled by a positive parameter. As this scale parameter dynamically decreases from 1 to 0, the DRMLL algorithm transforms from the BYY harmony learning with adaptive model selection to the final maximum likelihood (ML) learning. It is demonstrated by simulation experiments that the DRMLL algorithm can not only select the correct number of actual Gaussian distributions in a dataset, but also obtain ML estimates of the parameters in the original mixture.

A gradient entropy regularized likelihood learning algorithm on gaussian mixture with automatic model selection

Entropy Regularized Likelihood Learning on Gaussian Mixture: Two Gradient Implementations for Automatic Model Selection

A generalized competitive learning algorithm on gaussian mixture with automatic model selection

Letters: An iterative algorithm for entropy regularized likelihood learning on Gaussian mixture with automatic model selection

Generalized Competitive Learning of Gaussian Mixture Models

A Semi-Supervised Learning Algorithm on Gaussian Mixture with Automatic Model Selection

Gaussian mixture density modeling and decomposition with weighted likelihood

Renyi entropy penalized learning algorithm for Gaussian mixture with automated model selection

Entropy Penalized Automated Model Selection On Gaussian Mixture

Dynamically regularized maximum likelihood learning of Gaussian mixtures

Asymptotic Convergence Properties of Entropy Regularized Likelihood Learning on Finite Mixtures with Automatic Model Selection

Two Further Gradient Byy Learning Rules For Gaussian Mixture With Automated Model Selection

Agradient BYY harmony learning rule on Gaussian mixture with automated model selection

Harmonious Competition Learning for Gaussian Mixtures

Automatic Model Selection Of The Mixtures Of Gaussian Processes For Regression

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Dynamically regularized harmony learning of Gaussian mixtures

Adaptive Learning Algorithm Based on Mixture Gaussian Background

An Adaptive Gradient BYY Learning Rule for Poisson Mixture with Automated Model Selection

Byy Harmony Enforcing Regularization For Gaussian Mixture Learning

Parameter Estimation of Poisson Mixture with Automated Model Selection Through BYY Harmony Learning