Abstract:Missing data is an issue that can negatively impact any task performed with the available data and it is often found in real-world domains such as healthcare. One of the most common strategies to address this issue is to perform imputation, where the missing values are replaced by estimates. Several approaches based on statistics and machine learning techniques have been proposed for this purpose, including deep learning architectures such as generative adversarial networks and autoencoders. In this work, we propose a novel siamese neural network suitable for missing data imputation, which we call Siamese Autoencoder-based Approach for Imputation (SAEI). Besides having a deep autoencoder architecture, SAEI also has a custom loss function and triplet mining strategy that are tailored for the missing data issue. The proposed SAEI approach is compared to seven state-of-the-art imputation methods in an experimental setup that comprises 14 heterogeneous datasets of the healthcare domain injected with Missing Not At Random values at a rate between 10% and 60%. The results show that SAEI significantly outperforms all the remaining imputation methods for all experimented settings, achieving an average improvement of 35%. This work is an extension of the article Siamese Autoencoder-Based Approach for Missing Data Imputation (Pereira, et al. 2023) presented at the International Conference on Computational Science 2023. It includes new experiments focused on runtime, generalization capabilities, and the impact of the imputation in classification tasks, where the results show that SAEI is the imputation method that induces the best classification results, improving the F1 scores for 50% of the used datasets.

A Hybrid Method for Incomplete Data Imputation.

Local Similarity Imputation Based on Fast Clustering for Incomplete Data in Cyber-Physical Systems

Missing value imputation algorithm based on clustering and auto- encoder

A Data Imputation Method Based on Deep Belief Network

A Hybrid Imputation Method Based on Denoising Restricted Boltzmann Machine

Relational Data Imputation with Quality Guarantee.

Multiple Imputation with Denoising Autoencoder using Metamorphic Truth and Imputation Feedback

Incomplete Big Data Imputation Algorithm Based on Deep Learning

Missing Data Imputation by Utilizing Information Within Incomplete Instances

Imputation using information fusion technique for sensor generated incomplete data with high missing gap

Efficient missing data imputation for supervised learning.

MIDIA: exploring denoising autoencoders for missing data imputation

On-Line Imputation For Missing Values

Hybrid Multi-kernels Estimation Method for Data Imputation

Incomplete High-Dimensional Data Imputation Algorithm Using Feature Selection and Clustering Analysis on Cloud.

Missing Data Imputation for Machine Learning.

Win-Win: On Simultaneous Clustering and Imputing over Incomplete Data

Best Fit Missing Value Imputation (BFMVI) Algorithm for Incomplete Data in the Internet of Things.

SICE: an improved missing data imputation technique

Efficient Utilization of Missing Data in Cost-Sensitive Learning

Siamese autoencoder architecture for the imputation of data missing not at random