Abstract:The missing data issue is ubiquitous in health studies. Variable selection in the presence of both missing covariates and outcomes is an important statistical research topic but has been less studied. Existing literature focuses on parametric regression techniques that provide direct parameter estimates of the regression model. Flexible nonparametric machine learning methods considerably mitigate the reliance on the parametric assumptions, but do not provide as naturally defined variable importance measure as the covariate effect native to parametric models. We investigate a general variable selection approach when both the covariates and outcomes can be missing at random and have general missing data patterns. This approach exploits the flexibility of machine learning modeling techniques and bootstrap imputation, which is amenable to nonparametric methods in which the covariate effects are not directly available. We conduct expansive simulations investigating the practical operating characteristics of the proposed variable selection approach, when combined with four tree-based machine learning methods, XGBoost, Random Forests, Bayesian Additive Regression Trees (BART) and Conditional Random Forests, and two commonly used parametric methods, lasso and backward stepwise selection. Numeric results suggest that when combined with bootstrap imputation, XGBoost and BART have the overall best variable selection performance with respect to the $F_1$ score and Type I error across various settings. In general, there is no significant difference in the variable selection performance due to imputation methods. We further demonstrate the methods via a case study of risk factors for 3-year incidence of metabolic syndrome with data from the Study of Women's Health Across the Nation.

A hybrid deterministic–deterministic approach for high-dimensional Bayesian variable selection with a default prior

Scalable Bayesian variable selection for structured high‐dimensional data

Bayesian variable selection in linear regression models with instrumental variables

Bayesian Variable Selection with Related Predictors

Bayesian Nonparametric Variable Selection as an Exploratory Tool for Finding Genes that Matter

Scalable Approximations of Marginal Posteriors in Variable Selection

Comparing Stochastic Optimization Methods for Variable Selection in Binary Outcome Prediction, With Application to Health Policy

Variable Importance Assessments and Backward Variable Selection for High-Dimensional Data

Multivariate Bayesian variable selection with application to multi-trait genetic fine mapping

Spatial Knockoff Bayesian Variable Selection in Genome-Wide Association Studies

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

Scalable Bayesian bi-level variable selection in generalized linear models

Variable selection in Bayesian generalized linear-mixed models: an illustration using candidate gene case-control association studies

Bayesian Variable Selection in Linear Regression in One Pass for Large Data Sets

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Bayesian Variable Selection for Probit Mixed Models Applied to Gene Selection

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

A robust variable screening procedure for ultra-high dimensional data

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

Variational Bayes for high-dimensional proportional hazards models with applications within gene expression