Abstract:In the realm of medical datasets, particularly when considering diabetes, the occurrence of data incompleteness is a prevalent issue. Unveiling valuable patterns through medical data analysis is crucial for early and precise medical predictions. However, the quality of data and the proper handling of missing data hold significant significance. To address this challenge, imputation stands as a robust approach. The main goal of this paper aims to provide a comprehensive investigation into the effects brought about by Machine Learning (ML) based imputation techniques, specifically K Nearest Neighbor Imputation (KNNI), Multiple Imputation by Chained Equations (MICE), and MissForest. Results of all three techniques are compared with the complete dataset for five missing rates (10% to 50%), and evaluated using four categories of evaluation criteria i.e. (1) model performance, (2) imputation error rate (Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), Coefficient of Determination (R^2) values), (3) Pearson correlation analysis and, (4) model selection basis (Bayesian information criterion (BIC), Akaike information criterion (AIC), values). Model performance includes accuracy, precision, recall, F1 score, and Matthews Correlation Coefficient (Mcoff) score of four ML classifiers viz. (a) Random Forest (RF), (b) Support vector machine (SVM), (c) AdaBoost, (d) XGBoost (XGB). For all missing rate cases, the MissForest technique is better than the KNNI and MICE in accuracy and Mcoff in 80% of cases, precision in 40% of cases, recall in 60% of cases, F1 score, MAE, RMSE, R^2 in 100% of cases, AIC in 80% of cases, and BIC values in 100% of cases. Also, the correlation analysis confirms that the MissForest imputation preserves association between the variables, like the complete dataset. Overall, our findings suggest that MissForest is a better machine learning-based imputation technique for handling missing data in diabetes research.

Modulo 9 model-based learning for missing data imputation

Machine Learning Based Missing Values Imputation in Categorical Datasets

Missing Values Imputation Based on Iterative Learning

Information-decomposition-model-based Missing Value Estimation for Not Missing at Random Dataset

Missing Data Imputation: Focusing on Single Imputation.

Missing data imputation using correlation coefficient and min-max normalization weighting

Machine Learning for Missing Value Imputation

Integrated ECOD-KNN Algorithm for Missing Values Imputation in Datasets: Outlier Removal

On Missing Data Imputation for IRB Models

Missingness-Pattern-Adaptive Learning With Incomplete Data

CHOOSING APPROPRIATE IMPUTATION METHODS FOR MISSING DATA: A DECISION ALGORITHM ON METHODS FOR MISSING DATA

Machine Learning with Incomplete Datasets Using Multi-Objective Optimization Models

Impact of machine learning-based imputation techniques on medical datasets- a comparative analysis

Proposition of a Theoretical Model for Missing Data Imputation using Deep Learning and Evolutionary Algorithms

Impact of Missing Values in Machine Learning: A Comprehensive Analysis

Performance Comparison of Hot-Deck Imputation, K-Nearest Neighbor Imputation, and Predictive Mean Matching in Missing Value Handling, Case Study: March 2019 SUSENAS Kor Dataset

Efficient missing data imputation for supervised learning.

A Probabilistic Approach for Missing Data Imputation

Missing Data Imputation for Classification Problems

Discrete Missing Data Imputation Using Multilayer Perceptron and Momentum Gradient Descent

An Intelligent Missing Data Imputation Techniques: A Review