Abstract:The Health and Aging Brain Study–Health Disparities (HABS–HD) project seeks to understand the biological, social, and environmental factors that impact brain aging among diverse communities. A common issue for HABS–HD is missing data. It is impossible to achieve accurate machine learning (ML) if data contain missing values. Therefore, developing a new imputation methodology has become an urgent task for HABS–HD. The three missing data assumptions, (1) missing completely at random (MCAR), (2) missing at random (MAR), and (3) missing not at random (MNAR), necessitate distinct imputation approaches for each mechanism of missingness. Several popular imputation methods, including listwise deletion, min, mean, predictive mean matching (PMM), classification and regression trees (CART), and missForest, may result in biased outcomes and reduced statistical power when applied to downstream analyses such as testing hypotheses related to clinical variables or utilizing machine learning to predict AD or MCI. Moreover, these commonly used imputation techniques can produce unreliable estimates of missing values if they do not account for the missingness mechanisms or if there is an inconsistency between the imputation method and the missing data mechanism in HABS–HD. Therefore, we proposed a three-step workflow to handle missing data in HABS–HD: (1) missing data evaluation, (2) imputation, and (3) imputation evaluation. First, we explored the missingness in HABS–HD. Then, we developed a machine learning-based multiple imputation method (MLMI) for imputing missing values. We built four ML-based imputation models (support vector machine (SVM), random forest (RF), extreme gradient boosting (XGB), and lasso and elastic-net regularized generalized linear model (GLMNET)) and adapted the four ML-based models to multiple imputations using the simple averaging method. Lastly, we evaluated and compared MLMI with other common methods. Our results showed that the three-step workflow worked well for handling missing values in HABS–HD and the ML-based multiple imputation method outperformed other common methods in terms of prediction performance and change in distribution and correlation. The choice of missing handling methodology has a significant impact on the accompanying statistical analyses of HABS–HD. The conceptual three-step workflow and the ML-based multiple imputation method perform well for our Alzheimer’s disease models. They can also be applied to other disease data analyses.

Implementing multiple imputations for addressing missing data in multireader multicase design studies

Missing Data Imputation: Focusing on Single Imputation.

Dealing with missing data in multi-informant studies: A comparison of approaches

Missing Data Imputation in Balanced Construction for Incomplete Block Designs

Imputation methods for mixed datasets in bioarchaeology

Multiple Imputation with Multivariate Imputation by Chained Equation (mice) Package

A Realistic Evaluation of Methods for Handling Missing Data When There is a Mixture of MCAR, MAR, and MNAR Mechanisms in the Same Dataset

A Description of Missing Data in Single-Case Experimental Designs Studies and an Evaluation of Single Imputation Methods

Multiple Imputation Methods for Missing Multilevel Ordinal Outcomes

Multiple imputation of missing data in multilevel ecological momentary assessments: an example using smoking cessation study data

Missing Data Imputation for a Multivariate Outcome of Mixed Variable Types

Solving the "many variables" problem in MICE with principal component regression

Evaluation of multiple imputation to address intended and unintended missing data in case-cohort studies with a binary endpoint

An Efficient Multiple Imputation Algorithm for Control-Based and Delta-Adjusted Pattern Mixture Models using SAS

A Machine Learning-Based Multiple Imputation Method for the Health and Aging Brain Study–Health Disparities

A Bayesian two-step multiple imputation approach based on mixed models for the missing in EMA data

A method for comparing multiple imputation techniques: A case study on the U.S. national COVID cohort collaborative

Adjusting Survey Response Distributions Using Multiple Imputation: A Simulation with External Validation

Multiple Imputation with Factor Scores: A Practical Approach for Handling Simultaneous Missingness Across Items in Longitudinal Designs

CHOOSING APPROPRIATE IMPUTATION METHODS FOR MISSING DATA: A DECISION ALGORITHM ON METHODS FOR MISSING DATA

On Missing Data Imputation for IRB Models