Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

Greedy EM Algorithm for Robust T-Mixture Modeling

Gaussian mixture density modeling and decomposition with weighted likelihood

A revision for gaussian mixture density decomposition algorithm

An Efficient Greedy EM Algorithm for Gaussian Mixture for Adaptive Model Selection Using the Kurtosis and Skewness Criterion

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Competitive EM Algorithm for Finite Mixture Models

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

EM Algorithms for Gaussian Mixtures with Split-and-merge Operation

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

Gaussian Mixture Learning Via Robust Competitive Agglomeration

A Robust and Flexible EM Algorithm for Mixtures of Elliptical Distributions with Missing Data

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning

A Split and Merge EM Algorithm for Color Image Segmentation

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

The Infinite Student'S T-Mixture For Robust Modeling

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Statistical Convergence of the EM Algorithm on Gaussian Mixture Models

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

An EM Gradient Algorithm for Mixture Models with Components Derived from the Manly Transformation