Abstract:This paper tackles the problem of missing data imputation for noisy and non-Gaussian data. A classical imputation method, the Expectation Maximization (EM) algorithm for Gaussian mixture models, has shown interesting properties when compared to other popular approaches such as those based on k-nearest neighbors or on multiple imputations by chained equations. However, Gaussian mixture models are known to be non-robust to heterogeneous data, which can lead to poor estimation performance when the data is contaminated by outliers or follows non-Gaussian distributions. To overcome this issue, a new EM algorithm is investigated for mixtures of elliptical distributions with the property of handling potential missing data. This paper shows that this problem reduces to the estimation of a mixture of Angular Gaussian distributions under generic assumptions (i.e., each sample is drawn from a mixture of elliptical distributions, which is possibly different for one sample to another). In that case, the complete-data likelihood associated with mixtures of elliptical distributions is well adapted to the EM framework with missing data thanks to its conditional distribution, which is shown to be a multivariate $t$-distribution. Experimental results on synthetic data demonstrate that the proposed algorithm is robust to outliers and can be used with non-Gaussian data. Furthermore, experiments conducted on real-world datasets show that this algorithm is very competitive when compared to other classical imputation methods.

Mixed Graphical Models with Missing Data and the Partial Imputation EM Algorithm

Factorization of posteriors and partial imputation algorithm for graphical models with missing data

A Bipartite Graph Based Method for Traffic Continuous Data Imputation

High Dimensional Semiparametric Latent Graphical Model for Mixed Data

Mixed and missing data: a unified treatment with latent graphical models

A Robust and Flexible EM Algorithm for Mixtures of Elliptical Distributions with Missing Data

High-dimensional Mixed Graphical Models

Data Imputation from the Perspective of Graph Dirichlet Energy

Gaussian Graphical Model Estimation and Selection for High-Dimensional Incomplete Data Using Multiple Imputation and Horseshoe Estimators

Missing Data Exploration: Highlighting Graphical Presentation of Missing Pattern.

Graphical Models for Processing Missing Data

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

An Imputation-Consistency Algorithm for High-Dimensional Missing Data Problems and Beyond

Joint estimation of multiple dependent Gaussian graphical models with applications to mouse genomics

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

High-Dimensional Undirected Graphical Models for Arbitrary Mixed Data

An Imputation model by Dirichlet Process Mixture of Elliptical Copulas for Data of Mixed Type

Imputing Missing Data by Fully Conditional Models : Some Cautionary Examples and Guidelines

Graphical Models of Entangled Missingness

Graphical model for mixed data types

Partial Gaussian Graphical Model Estimation