Abstract:Missing data is an issue that can negatively impact any task performed with the available data and it is often found in real-world domains such as healthcare. One of the most common strategies to address this issue is to perform imputation, where the missing values are replaced by estimates. Several approaches based on statistics and machine learning techniques have been proposed for this purpose, including deep learning architectures such as generative adversarial networks and autoencoders. In this work, we propose a novel siamese neural network suitable for missing data imputation, which we call Siamese Autoencoder-based Approach for Imputation (SAEI). Besides having a deep autoencoder architecture, SAEI also has a custom loss function and triplet mining strategy that are tailored for the missing data issue. The proposed SAEI approach is compared to seven state-of-the-art imputation methods in an experimental setup that comprises 14 heterogeneous datasets of the healthcare domain injected with Missing Not At Random values at a rate between 10% and 60%. The results show that SAEI significantly outperforms all the remaining imputation methods for all experimented settings, achieving an average improvement of 35%. This work is an extension of the article Siamese Autoencoder-Based Approach for Missing Data Imputation (Pereira, et al. 2023) presented at the International Conference on Computational Science 2023. It includes new experiments focused on runtime, generalization capabilities, and the impact of the imputation in classification tasks, where the results show that SAEI is the imputation method that induces the best classification results, improving the F1 scores for 50% of the used datasets.

Differentiable and Scalable Generative Adversarial Models for Data Imputation

An Efficient Generative Data Imputation Toolbox with Adversarial Learning.

Denoising Diffusion Straightforward Models for Energy Conversion Monitoring Data Imputation

Improved generative adversarial imputation networks for missing data

Efficient and effective data imputation with influence functions

Missing Features Reconstruction Using a Wasserstein Generative Adversarial Imputation Network

Multiple Imputation with Denoising Autoencoder using Metamorphic Truth and Imputation Feedback

A time series continuous missing values imputation method based on generative adversarial networks

GAGIN: generative adversarial guider imputation network for missing data

Are deep learning models superior for missing data imputation in large surveys? Evidence from an empirical comparison

sasdim: self-adaptive noise scaling diffusion model for spatial time series imputation

Siamese autoencoder architecture for the imputation of data missing not at random

Spatial-Attention and Demographic-Augmented Generative Adversarial Imputation Network for Population Health Data Reconstruction

Diffusion Models for Tabular Data Imputation and Synthetic Data Generation

A data imputation method for multivariate time series based on generative adversarial network.

The MIDAS Touch: Accurate and Scalable Missing-Data Imputation with Deep Learning

Traffic Volume Imputation Using Attention-based Spatiotemporal Generative Adversarial Imputation Network

Missing data imputation framework for bridge structural health monitoring based on slim generative adversarial networks

Natural generative noise diffusion model imputation

PC-GAIN: Pseudo-label conditional generative adversarial imputation networks for incomplete data

Generative Adversarial Networks for Imputing Sparse Learning Performance