Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

DSP-TMM: A Robust Cluster Analysis Method Based on Diversity Self-Paced T-Mixture Model

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Self -Paced Mixture of T Distribution Model.

Semisupervised Robust Modeling of Multimode Industrial Processes for Quality Variable Prediction Based on Student's T Mixture Model.

Component-wise Adaptive Trimming For Robust Mixture Regression

The Infinite Student'S T-Mixture For Robust Modeling

Robust $K$-Means-type Clustering for Noisy Data

Factor Analysis Latent Subspace Modeling and Robust Fuzzy Clustering Using $t$-Distributions

Distributed Density Estimation Based on a Mixture of Factor Analyzers in a Sensor Network.

Analysis of multivariate Gaussian mixture model based on DRJMCMC method

Robust multivariate mixture regression models with incomplete data

A Method of Two-Stage Clustering Learning Based on Improved DBSCAN and Density Peak Algorithm

Repulsive Mixture Models of Exponential Family PCA for Clustering

t distribution-based robust semiparametric mixture regression model

Optimal Clustering of Discrete Mixtures: Binomial, Poisson, Block Models, and Multi-layer Networks

CDP Mixture Models for Data Clustering

Maximum Likelihood Inference in Robust Linear Mixed-Effects Models Using Multivariate T Distributions

Flexible Clustering with a Sparse Mixture of Generalized Hyperbolic Distributions

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Robust Gaussian Mixture Modeling: A -Divergence Based Approach