Abstract:Data analysis usually suffers from the Missing Not At Random (MNAR) problem, where the cause of the value missing is not fully observed. Compared to the naive Missing Completely At Random (MCAR) problem, it is more in line with the realistic scenario whereas more complex and challenging. Existing statistical methods model the MNAR mechanism by different decomposition of the joint distribution of the complete data and the missing mask. But we empirically find that directly incorporating these statistical methods into deep generative models is sub-optimal. Specifically, it would neglect the confidence of the reconstructed mask during the MNAR imputation process, which leads to insufficient information extraction and less-guaranteed imputation quality. In this paper, we revisit the MNAR problem from a novel perspective that the complete data and missing mask are two modalities of incomplete data on an equal footing. Along with this line, we put forward a generative-model-specific joint probability decomposition method, conjunction model, to represent the distributions of two modalities in parallel and extract sufficient information from both complete data and missing mask. Taking a step further, we exploit a deep generative imputation model, namely GNR, to process the real-world missing mechanism in the latent space and concurrently impute the incomplete data and reconstruct the missing mask. The experimental results show that our GNR surpasses state-of-the-art MNAR baselines with significant margins (averagely improved from 9.9% to 18.8% in RMSE) and always gives a better mask reconstruction accuracy which makes the imputation more principle.

Extended Missing Data Imputation via GANs for Ranking Applications

Improved generative adversarial imputation networks for missing data

A data imputation method for multivariate time series based on generative adversarial network.

Missing value imputation in multivariate time series with end-to-end generative adversarial networks

Imputation of Missing Data with Class Imbalance using Conditional Generative Adversarial Networks

GAGIN: generative adversarial guider imputation network for missing data

A time series continuous missing values imputation method based on generative adversarial networks

Multivariate Time Series Imputation with Generative Adversarial Networks.

AMING:Adaptive-Learning Mechanism Based Missing-Value Imputation Networks Using GAN in Industrial Processes

Deep Generative Imputation Model for Missing Not At Random Data

ImputeGAN: Generative Adversarial Network for Multivariate Time Series Imputation.

MisGAN: Learning from Incomplete Data with Generative Adversarial Networks

IFGAN: Missing Value Imputation using Feature-specific Generative Adversarial Networks

Trend-Aware Data Imputation Based on Generative Adversarial Network for Time Series

Listwise learning to rank method combining approximate NDCG ranking indicator with Conditional Generative Adversarial Networks

SEGAN: semi-supervised learning approach for missing data imputation

Detracking Autoencoding Conditional Generative Adversarial Network: Improved Generative Adversarial Network Method for Tabular Missing Value Imputation

PC-GAIN: Pseudo-label conditional generative adversarial imputation networks for incomplete data

A Probabilistic Ranking Framework for Web-Based Relational Data Imputation

Multiple imputation method of missing credit risk assessment data based on generative adversarial networks

Missing Features Reconstruction Using a Wasserstein Generative Adversarial Imputation Network