Abstract:This paper tackles the problem of missing data imputation for noisy and non-Gaussian data. A classical imputation method, the Expectation Maximization (EM) algorithm for Gaussian mixture models, has shown interesting properties when compared to other popular approaches such as those based on k-nearest neighbors or on multiple imputations by chained equations. However, Gaussian mixture models are known to be non-robust to heterogeneous data, which can lead to poor estimation performance when the data is contaminated by outliers or follows non-Gaussian distributions. To overcome this issue, a new EM algorithm is investigated for mixtures of elliptical distributions with the property of handling potential missing data. This paper shows that this problem reduces to the estimation of a mixture of Angular Gaussian distributions under generic assumptions (i.e., each sample is drawn from a mixture of elliptical distributions, which is possibly different for one sample to another). In that case, the complete-data likelihood associated with mixtures of elliptical distributions is well adapted to the EM framework with missing data thanks to its conditional distribution, which is shown to be a multivariate $t$-distribution. Experimental results on synthetic data demonstrate that the proposed algorithm is robust to outliers and can be used with non-Gaussian data. Furthermore, experiments conducted on real-world datasets show that this algorithm is very competitive when compared to other classical imputation methods.

An Efficient Greedy EM Algorithm for Gaussian Mixture for Adaptive Model Selection Using the Kurtosis and Skewness Criterion

A Kurtosis and Skewness Based Criterion for Model Selection on Gaussian Mixture

A revision for gaussian mixture density decomposition algorithm

Gaussian mixture density modeling and decomposition with weighted likelihood

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

Entropy Penalized Automated Model Selection On Gaussian Mixture

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Statistical Convergence of the EM Algorithm on Gaussian Mixture Models

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Benefits of over-parameterization with EM

Model selection of Gaussian mixture process and its application

Learning Gaussian mixture model with a maximization-maximization algorithm for image classification

A gradient entropy regularized likelihood learning algorithm on gaussian mixture with automatic model selection

Gaussian Mixture Learning Via Robust Competitive Agglomeration

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

A Dynamic Model Selection Algorithm for Mixtures of Gaussian Processes

A Robust and Flexible EM Algorithm for Mixtures of Elliptical Distributions with Missing Data