Abstract:This paper tackles the problem of missing data imputation for noisy and non-Gaussian data. A classical imputation method, the Expectation Maximization (EM) algorithm for Gaussian mixture models, has shown interesting properties when compared to other popular approaches such as those based on k-nearest neighbors or on multiple imputations by chained equations. However, Gaussian mixture models are known to be non-robust to heterogeneous data, which can lead to poor estimation performance when the data is contaminated by outliers or follows non-Gaussian distributions. To overcome this issue, a new EM algorithm is investigated for mixtures of elliptical distributions with the property of handling potential missing data. This paper shows that this problem reduces to the estimation of a mixture of Angular Gaussian distributions under generic assumptions (i.e., each sample is drawn from a mixture of elliptical distributions, which is possibly different for one sample to another). In that case, the complete-data likelihood associated with mixtures of elliptical distributions is well adapted to the EM framework with missing data thanks to its conditional distribution, which is shown to be a multivariate $t$-distribution. Experimental results on synthetic data demonstrate that the proposed algorithm is robust to outliers and can be used with non-Gaussian data. Furthermore, experiments conducted on real-world datasets show that this algorithm is very competitive when compared to other classical imputation methods.

An EM type algorithm for maximum likelihood estimation of the normal–inverse Gaussian distribution

A robust multivariate Birnbaum–Saunders distribution: EM estimation

EM-estimation and modeling of heavy-tailed processes with the multivariate normal inverse Gaussian distribution

Maximum Likelihood from Incomplete Data Via the EM Algorithm

Value at Risk and Expected Shortfall for Normal Variance Mean Mixtures of Finite Weighted Inverse Gaussian Distributions

The expectation-maximization algorithm for autoregressive models with normal inverse Gaussian innovations

Normal inverse Gaussian autoregressive model using EM algorithm

Em Algorithm of the Truncated Multinormal Distribution with Linear Restriction on the Variables

Estimation of the Inverse Gaussian Distribution Function

An EM algorithm for estimating the parameters of the multivariate skew-normal distribution with censored responses

Clustering with the multivariate normal inverse Gaussian distribution

Benefits of over-parameterization with EM

Learning-based EM algorithm for normal-inverse Gaussian mixture model with application to extrasolar planets

Normal Inverse Gaussian Distributions and Stochastic Volatility Modelling

Regularized EM algorithm

Alternating minimization algorithm with a probability generating function-based distance measure

Properties and maximum likelihood estimation of the gamma-normal and related probability distributions

A Robust and Flexible EM Algorithm for Mixtures of Elliptical Distributions with Missing Data

Normalized Maximum Likelihood with Luckiness for Multivariate Normal Distributions

Maximum Likelihood Estmators for the Parameters of Normal Population in Randomly Censored Data

A Normal Weighted Inverse Gaussian Distribution for Skewed and Heavy-Tailed Data