Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

Self -Paced Mixture of T Distribution Model.

Gaussian mixture density modeling and decomposition with weighted likelihood

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

A Robust Infinite Gaussian Mixture Model and Its Application in Fault Detection of Nonlinear Multimode Processes

The Infinite Student'S T-Mixture For Robust Modeling

Improved fittings for distribution of vehicles' velocity in intelligent transportation systems

Semisupervised Robust Modeling of Multimode Industrial Processes for Quality Variable Prediction Based on Student's T Mixture Model.

Gaussian Mixture Model with Rare Events

Gaussian Mixture Models with Rare Events.

t distribution-based robust semiparametric mixture regression model

Extending Growth Mixture Models Using Continuous Non-Elliptical Distributions

Stochastic Generalized Method of Moments.

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

A Specialized Probability Density Function for the Input of Mixture of Gaussian Processes.

Entropy Penalized Automated Model Selection On Gaussian Mixture

A Generalized Finite Mixture Model for Asymmetric Probability Distribution Observations

Gaussian Mixture Model Clustering with Incomplete Data

Learning Probability Density Functions from Marginal Distributions with Applications to Gaussian Mixtures

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Gaussian Mixture Model with Local Consistency