Abstract:The Health and Aging Brain Study–Health Disparities (HABS–HD) project seeks to understand the biological, social, and environmental factors that impact brain aging among diverse communities. A common issue for HABS–HD is missing data. It is impossible to achieve accurate machine learning (ML) if data contain missing values. Therefore, developing a new imputation methodology has become an urgent task for HABS–HD. The three missing data assumptions, (1) missing completely at random (MCAR), (2) missing at random (MAR), and (3) missing not at random (MNAR), necessitate distinct imputation approaches for each mechanism of missingness. Several popular imputation methods, including listwise deletion, min, mean, predictive mean matching (PMM), classification and regression trees (CART), and missForest, may result in biased outcomes and reduced statistical power when applied to downstream analyses such as testing hypotheses related to clinical variables or utilizing machine learning to predict AD or MCI. Moreover, these commonly used imputation techniques can produce unreliable estimates of missing values if they do not account for the missingness mechanisms or if there is an inconsistency between the imputation method and the missing data mechanism in HABS–HD. Therefore, we proposed a three-step workflow to handle missing data in HABS–HD: (1) missing data evaluation, (2) imputation, and (3) imputation evaluation. First, we explored the missingness in HABS–HD. Then, we developed a machine learning-based multiple imputation method (MLMI) for imputing missing values. We built four ML-based imputation models (support vector machine (SVM), random forest (RF), extreme gradient boosting (XGB), and lasso and elastic-net regularized generalized linear model (GLMNET)) and adapted the four ML-based models to multiple imputations using the simple averaging method. Lastly, we evaluated and compared MLMI with other common methods. Our results showed that the three-step workflow worked well for handling missing values in HABS–HD and the ML-based multiple imputation method outperformed other common methods in terms of prediction performance and change in distribution and correlation. The choice of missing handling methodology has a significant impact on the accompanying statistical analyses of HABS–HD. The conceptual three-step workflow and the ML-based multiple imputation method perform well for our Alzheimer’s disease models. They can also be applied to other disease data analyses.

Comparison of the effects of imputation methods for missing data in predictive modelling of cohort study datasets

A method for comparing multiple imputation techniques: A case study on the U.S. national COVID cohort collaborative

The Optimal Machine Learning-Based Missing Data Imputation for the Cox Proportional Hazard Model

Multi-metric comparison of machine learning imputation methods with application to breast cancer survival

How handling missing data may impact conclusions: A comparison of six different imputation methods for categorical questionnaire data

Comparison of Missing Data Imputation Methods using the Framingham Heart study dataset

A simulation study on missing data imputation for dichotomous variables using statistical and machine learning methods

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

An Experimental Survey of Missing Data Imputation Algorithms

Assessing the Impact of Imputation on the Interpretations of Prediction Models: A Case Study on Mortality Prediction for Patients with Acute Myocardial Infarction.

Comparison between inverse-probability weighting and multiple imputation in Cox model with missing failure subtype

A Comparison of Multiple Imputation Methods for Missing Covariate Values in Recurrent Event Data

A Machine Learning-Based Multiple Imputation Method for the Health and Aging Brain Study–Health Disparities

Evaluations on Several Imputation Approaches of Integrated Omics Data

Handling missing values in healthcare data: A systematic review of deep learning-based imputation techniques

Impact of machine learning-based imputation techniques on medical datasets- a comparative analysis

Comparison of machine learning methods for clinical data imputation among a real-world lung cancer cohort

Does imputation matter? Benchmark for predictive models

Imputation of missing values for electronic health record laboratory data

Handling missing data and measurement error for early-onset myopia risk prediction models

The impact of different imputation methods on estimates and model performance: an example using a risk prediction model for premature mortality