Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

Analysis of multivariate Gaussian mixture model based on DRJMCMC method

Gaussian mixture density modeling and decomposition with weighted likelihood

A revision for gaussian mixture density decomposition algorithm

Model Selection Prediction for the Mixture of Gaussian Processes with RJMCMC

A Robust Infinite Gaussian Mixture Model and Its Application in Fault Detection of Nonlinear Multimode Processes

A multimode process monitoring method based Gaussian mixture models

Multimode Process Monitoring with PCA Mixture Model

A Novel Bayesian Robust Model and Its Application for Fault Detection and Automatic Supervision of Nonlinear Process

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

Convergence Analysis of MCMC Algorithms for Bayesian Multivariate Linear Regression with Non‐Gaussian Errors

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Bayesian Regularized Gaussian Mixture Regression with Application to Soft Sensor Modeling for Multi-Mode Industrial Processes

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

Automatic Model Selection Of The Mixtures Of Gaussian Processes For Regression

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

Bayesian Inference on Principal Component Analysis Using Reversible Jump Markov Chain Monte Carlo.

A Nonparametric Estimation Method for the Multivariate Mixture Models

Gaussian Mixture Models with Rare Events.

Gaussian Mixture Model with Rare Events