Abstract:Missing value imputation (MVI) is a key task in data science, in which learning models are built from incomplete data. In contrast to externally driven MVI algorithms, this study proposes a novel risk-minimisation-based MVI algorithm (RM-MVI) that considers both the internal characteristics of missing data and the external performance for specific classification applications. RM-MVI is technically designed for labelled data and is applied in two stages: filling with structural risk minimization (SRM) and refining with empirical risk minimization (ERM). In the filling stage, an autoencoder with a single hidden layer is trained on the original dataset without missing values. Missing values are first initialised with random numbers, and the imputation values are then preliminarily optimised based on the derived updating rule to minimise the structural risk-oriented objective function. After the imputation values have been preliminarily optimised in the filling stage, a neural-network-based classifier is trained in the refining stage to optimise the imputation values sophisticatedly by reducing the empirical risk. Experiments were conducted on several benchmark datasets to validate the feasibility, rationality, and effectiveness of the proposed RM-MVI algorithm. The results show that (1) the optimization processes of the imputation values corresponding to the SRM and ERM are convergent so that the optimized imputation values can be obtained; (2) SRM can ensure distribution consistency of the imputation values that are preliminarily optimised in the filling stage, while ERM can optimise the imputation values sophisticatedly in the refining stage, which is more helpful for classifier training; and (3) the RM-MVI algorithm can yield considerably better MVI performance on benchmark datasets than 11 well-known MVI algorithms, such as a 26% higher distribution consistency ratio and 2% to 5% higher testing accuracies for 6 classifiers on average. This demonstrates that RM-MVI is a viable approach for addressing MVI problems.

Order-Sensitive Imputation for Clustered Missing Values.

Missing Value Imputation via Clusterwise Linear Regression

Hybrid Missing Value Imputation Algorithms Using Fuzzy C-Means and Vaguely Quantified Rough Set

Machine Learning for Missing Value Imputation

Missing Data Imputation: Focusing on Single Imputation.

Missing Values Imputation Based on Iterative Learning

Missing value imputation using unsupervised machine learning techniques

Best Fit Missing Value Imputation (BFMVI) Algorithm for Incomplete Data in the Internet of Things.

Missing Value Imputation on Multidimensional Time Series

A Novel Fuzzy Rough Clustering Parameter-based missing value imputation

Machine Learning Based Missing Values Imputation in Categorical Datasets

Iterative missing value imputation based on feature importance

MIDIA: exploring denoising autoencoders for missing data imputation

A matrix completion-based multiview learning method for imputing missing values in buoy monitoring data

Missing Value Estimation Algorithms on Cluster and Representativeness Preservation of Gene Expression Microarray Data

Probabilistic Missing Value Imputation for Mixed Categorical and Ordered Data

A novel and efficient risk minimization-based missing value imputation algorithm

Method for Incomplete and Imbalanced Data Based on Multivariate Imputation by Chained Equations and Ensemble Learning

Missing Value Estimation using Clustering and Deep Learning within Multiple Imputation Framework

Missing values imputation hypothesis: An experimental evaluation

Impact of Missing Values in Machine Learning: A Comprehensive Analysis