Abstract:The Health and Aging Brain Study–Health Disparities (HABS–HD) project seeks to understand the biological, social, and environmental factors that impact brain aging among diverse communities. A common issue for HABS–HD is missing data. It is impossible to achieve accurate machine learning (ML) if data contain missing values. Therefore, developing a new imputation methodology has become an urgent task for HABS–HD. The three missing data assumptions, (1) missing completely at random (MCAR), (2) missing at random (MAR), and (3) missing not at random (MNAR), necessitate distinct imputation approaches for each mechanism of missingness. Several popular imputation methods, including listwise deletion, min, mean, predictive mean matching (PMM), classification and regression trees (CART), and missForest, may result in biased outcomes and reduced statistical power when applied to downstream analyses such as testing hypotheses related to clinical variables or utilizing machine learning to predict AD or MCI. Moreover, these commonly used imputation techniques can produce unreliable estimates of missing values if they do not account for the missingness mechanisms or if there is an inconsistency between the imputation method and the missing data mechanism in HABS–HD. Therefore, we proposed a three-step workflow to handle missing data in HABS–HD: (1) missing data evaluation, (2) imputation, and (3) imputation evaluation. First, we explored the missingness in HABS–HD. Then, we developed a machine learning-based multiple imputation method (MLMI) for imputing missing values. We built four ML-based imputation models (support vector machine (SVM), random forest (RF), extreme gradient boosting (XGB), and lasso and elastic-net regularized generalized linear model (GLMNET)) and adapted the four ML-based models to multiple imputations using the simple averaging method. Lastly, we evaluated and compared MLMI with other common methods. Our results showed that the three-step workflow worked well for handling missing values in HABS–HD and the ML-based multiple imputation method outperformed other common methods in terms of prediction performance and change in distribution and correlation. The choice of missing handling methodology has a significant impact on the accompanying statistical analyses of HABS–HD. The conceptual three-step workflow and the ML-based multiple imputation method perform well for our Alzheimer’s disease models. They can also be applied to other disease data analyses.

Extreme Learning Machine for Missing Data Using Multiple Imputations

Multiple Imputation with Denoising Autoencoder using Metamorphic Truth and Imputation Feedback

Sample-Based Extreme Learning Machine with Missing Data

Are deep learning models superior for missing data imputation in large surveys? Evidence from an empirical comparison

Multiple Imputation for General Missing Data Patterns in the Presence of High-dimensional Data

Efficient missing data imputation for supervised learning.

Missing Values Imputation Based on Iterative Learning

Missing Data Imputation for Machine Learning.

The MIDAS Touch: Accurate and Scalable Missing-Data Imputation with Deep Learning

Machine Learning Based Missing Values Imputation in Categorical Datasets

Missing Value Estimation using Clustering and Deep Learning within Multiple Imputation Framework

Handling missing data in model-based clustering

Multiple imputation method of missing credit risk assessment data based on generative adversarial networks

Multiple Imputation Through XGBoost

Gaussian Processes for Missing Value Imputation

Discrete Missing Data Imputation Using Multilayer Perceptron and Momentum Gradient Descent

A Machine Learning-Based Multiple Imputation Method for the Health and Aging Brain Study–Health Disparities

Method for Incomplete and Imbalanced Data Based on Multivariate Imputation by Chained Equations and Ensemble Learning

Missing Data Analyses: a Hybrid Multiple Imputation Algorithm Using Gray System Theory and Entropy Based on Clustering

M-DEW: Extending Dynamic Ensemble Weighting to Handle Missing Values

Takagi-Sugeno Modeling of Incomplete Data for Missing Value Imputation with the Use of Alternate Learning