Abstract:The missing data issue is ubiquitous in health studies. Variable selection in the presence of both missing covariates and outcomes is an important statistical research topic but has been less studied. Existing literature focuses on parametric regression techniques that provide direct parameter estimates of the regression model. Flexible nonparametric machine learning methods considerably mitigate the reliance on the parametric assumptions, but do not provide as naturally defined variable importance measure as the covariate effect native to parametric models. We investigate a general variable selection approach when both the covariates and outcomes can be missing at random and have general missing data patterns. This approach exploits the flexibility of machine learning modeling techniques and bootstrap imputation, which is amenable to nonparametric methods in which the covariate effects are not directly available. We conduct expansive simulations investigating the practical operating characteristics of the proposed variable selection approach, when combined with four tree-based machine learning methods, XGBoost, Random Forests, Bayesian Additive Regression Trees (BART) and Conditional Random Forests, and two commonly used parametric methods, lasso and backward stepwise selection. Numeric results suggest that when combined with bootstrap imputation, XGBoost and BART have the overall best variable selection performance with respect to the $F_1$ score and Type I error across various settings. In general, there is no significant difference in the variable selection performance due to imputation methods. We further demonstrate the methods via a case study of risk factors for 3-year incidence of metabolic syndrome with data from the Study of Women's Health Across the Nation.

Methodes D’apprentissage Pour L’analyse Automatique Morphosyntaxique Et Lexicale-Semantique De La Langue Espagnole

A comparison of strategies for selecting auxiliary variables for multiple imputation

Analyses Using Multiple Imputation Need to Consider Missing Data in Auxiliary Variables

Multiple imputation using auxiliary imputation variables that only predict missingness can increase bias due to data missing not at random

A Realistic Evaluation of Methods for Handling Missing Data When There is a Mixture of MCAR, MAR, and MNAR Mechanisms in the Same Dataset

Accuracy of random-forest-based imputation of missing data in the presence of non-normality, non-linearity, and interaction

Auxiliary variables in multiple imputation in regression with missing X: a warning against including too many in small sample research

Missing at Random or Not: A Semiparametric Testing Approach

All-or-Nothing Transform and Remotely Keyed Encription Protocols

CHOOSING APPROPRIATE IMPUTATION METHODS FOR MISSING DATA: A DECISION ALGORITHM ON METHODS FOR MISSING DATA

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

A unified framework of analyzing missing data and variable selection using regularized likelihood

A Causal View on Bias in Missing Data Imputation: The Impact of Evil Auxiliary Variables on Norming of Test Scores

Multiple Imputation with Factor Scores: A Practical Approach for Handling Simultaneous Missingness Across Items in Longitudinal Designs

Random features models: a way to study the success of naive imputation

Flexible variable selection in the presence of missing data

Missing not at random models for latent growth curve analyses.

Handling Nonmonotone Missing Data with Available Complete-Case Missing Value Assumption

Dealing with missing data in multi-informant studies: A comparison of approaches

A Comparison of Three Popular Methods for Handling Missing Data: Complete-Case Analysis, Inverse Probability Weighting, and Multiple Imputation

Multiple Imputation When Variables Exceed Observations: An Overview of Challenges and Solutions