Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

Gaussian Mixture Learning Via Robust Competitive Agglomeration

Gaussian mixture density modeling and decomposition with weighted likelihood

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

A Semi-Supervised Learning Algorithm on Gaussian Mixture with Automatic Model Selection

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

On the robust learning mixtures of linear regressions

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Entropy Penalized Automated Model Selection On Gaussian Mixture

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

Gaussian Mixture Models with Rare Events.

Model selection of Gaussian mixture process and its application

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Robust Unsupervised Multi-task and Transfer Learning on Gaussian Mixture Models

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Mixture of robust Gaussian processes and its hard-cut EM algorithm with variational bounding approximation

Competitive EM Algorithm for Finite Mixture Models

Learning Gaussian Mixture Models By Structural Risk Minimization

Renyi entropy penalized learning algorithm for Gaussian mixture with automated model selection

Gaussian Mixture Model with Rare Events

An Efficient Greedy EM Algorithm for Gaussian Mixture for Adaptive Model Selection Using the Kurtosis and Skewness Criterion