Abstract:We study the problem of missing data imputation, which is a fundamental task in the area of data quality that aims to impute the missing data to achieve the completeness of datasets. Though the recent distribution-modeling-based techniques (e.g., distribution generation and distribution matching) can achieve state-of-the-art performance in terms of imputation accuracy, we notice that (1) they deploy a sophisticated deep learning model that tends to be overfitting for missing data imputation; (2) they directly rely on a global data distribution while overlooking the local information. Driven by the inherent variability in both missing data and missing mechanisms, in this paper, we explore the uncertain nature of this task and aim to address the limitations of existing works by proposing an uNcertainty-driven netwOrk for Missing data Imputation, termed NOMI. NOMI has three key components, i.e., the retrieval module, the neural network gaussian process imputator (NNGPI) and the uncertainty-based calibration module. NOMI~ runs these components sequentially and in an iterative manner to achieve a better imputation performance. Specifically, in the retrieval module, NOMI~ retrieves local neighbors of the incomplete data samples based on the pre-defined similarity metric. Subsequently, we design NNGPI~ that merges the advantages of both the Gaussian Process and the universal approximation capacity of neural networks. NNGPI~ models the uncertainty by learning the posterior distribution over the data to impute missing values while alleviating the overfitting issue. Moreover, we further propose an uncertainty-based calibration module that utilizes the uncertainty of the imputator on its prediction to help the retrieval module obtain more reliable local information, thereby further enhancing the imputation performance. We also demonstrate that our NOMI~ can be reformulated as an instance of the well-known Expectation Maximization (EM) algorithm, highlighting the strong theoretical foundation of our proposed methods. Extensive experiments are conducted over 12 real-world datasets. The results demonstrate the excellent performance of NOMI in terms of both accuracy and efficiency.

GAGIN: generative adversarial guider imputation network for missing data

A Global to Local Guiding Network for Missing Data Imputation.

Improved generative adversarial imputation networks for missing data

AMING:Adaptive-Learning Mechanism Based Missing-Value Imputation Networks Using GAN in Industrial Processes

A time series continuous missing values imputation method based on generative adversarial networks

IFGAN: Missing Value Imputation using Feature-specific Generative Adversarial Networks

PC-GAIN: Pseudo-label conditional generative adversarial imputation networks for incomplete data

Robust spatial temporal imputation based on spatio-temporal generative adversarial nets

Multiple imputation method of missing credit risk assessment data based on generative adversarial networks

Imputation of Missing Data with Class Imbalance using Conditional Generative Adversarial Networks

Extended Missing Data Imputation via GANs for Ranking Applications

DPGAN: A Dual-Path Generative Adversarial Network for Missing Data Imputation in Graphs

Missing data imputation with adversarially-trained graph convolutional networks

Deep Generative Imputation Model for Missing Not At Random Data

MisGAN: Learning from Incomplete Data with Generative Adversarial Networks

Data Imputation with Iterative Graph Reconstruction

Missing value imputation in multivariate time series with end-to-end generative adversarial networks

Missing Data Imputation with Uncertainty-Driven Network

Multivariate Time Series Imputation with Generative Adversarial Networks.

SEGAN: semi-supervised learning approach for missing data imputation

FragmGAN: Generative Adversarial Nets for Fragmentary Data Imputation and Prediction