Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

Active Function Cross-Entropy Clustering

Active Curve Axis Gaussian Mixture Models

Scalable Model-Based Cluster Analysis Using Clustering Features

An Efficient EM Algorithm for Two-Layer Mixture Model of Gaussian Process Functional Regressions

Robust EM algorithm for model-based curve clustering

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

Flexible Clustering with a Sparse Mixture of Generalized Hyperbolic Distributions

Regularization and optimization in model-based clustering

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

An Entropy Weighting Mixture Model for Subspace Clustering of High-Dimensional Data

Laplacian Regularized Gaussian Mixture Model for Data Clustering

Gaussian model for closed curves

Learning GMM Using Elliptically Contoured Distributions

Adaptive Parameter Estimation of GMM and Its Application in Clustering

Active Contours Driven by Gaussian Function and Adaptive-Scale Local Correntropy-Based K-means Clustering for Fast Image Segmentation

EGMM: an Evidential Version of the Gaussian Mixture Model for Clustering

Model-based Clustering with Sparse Covariance Matrices

Mixture of GANs for Clustering.

Automated Model Selection of the Two-Layer Mixtures of Gaussian Process Functional Regressions for Curve Clustering and Prediction