Abstract:This paper addresses the problem of robust Gaussian mixture modeling in the presence of outliers. We commence by introducing a general expectation-maximization (EM)-like scheme, called -BM, for iterative numerical computation of the minimum -divergence estimator (M DE). This estimator leverages Parzen's non-parametric ernel density estimate to down-weight low density regions associated with outlying measurements. Akin to the conventional EM, the -BM involves successive Maximizations of lower Bounds on the objective function of the M DE. However, differently from EM, these bounds are not exclusively reliant on conditional expectations. The -BM algorithm is applied to robust parameter estimation of a finite-order multivariate Gaussian mixture model (GMM). We proceed by introducing a new robust variant of the Bayesian information criterion (BIC) that penalizes the M DE's objective function. The proposed criterion, called -BIC, is conveniently applied for robust GMM order selection. In the paper, we also establish a data-driven procedure for selection of the kernel's bandwidth parameter. This procedure operates by minimizing an empirical asymptotic approximation of the mean-integrated-squared-error (MISE) between the underlying density and the estimated GMM density. Lastly, the -BM, the -BIC, and the MISE based selection of the kernel's bandwidth are combined into a unified framework for joint order selection and parameter estimation of a GMM. The advantages of the -divergence based framework over other robust approaches are illustrated in simulation studies involving synthetic and real data.

Maximum Likelihood Inference in Robust Linear Mixed-Effects Models Using Multivariate T Distributions

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Robust Transformation Mixed‐effects Models for Longitudinal Continuous Proportional Data

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robustified Maximum Likelihood Estimation in Generalized Partial Linear Mixed Model for Longitudinal Data

A Robust Threshold T Linear Mixed Model for Subgroup Identification Using Multivariate T Distributions

t distribution-based robust semiparametric mixture regression model

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Robust multivariate mixture regression models with incomplete data

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

ML-ESTIMATION OF THE T-DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME

Inference for High-Dimensional Linear Mixed-Effects Models: A Quasi-Likelihood Approach

ML ESTIMATION OF THE t DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME

Approximate Inferences for Nonlinear Mixed Effects Models with Scale Mixtures of Skew-Normal Distributions

Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models.

Maximum Ideal Likelihood Estimator: An New Estimation and Inference Framework for Latent Variable Models

Component-wise Adaptive Trimming For Robust Mixture Regression

Robust Bayesian cumulative probit linear mixed models for longitudinal ordinal data

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Maximum profile binomial likelihood estimation for the semiparametric Box--Cox power transformation model