Abstract:The missing data issue is ubiquitous in health studies. Variable selection in the presence of both missing covariates and outcomes is an important statistical research topic but has been less studied. Existing literature focuses on parametric regression techniques that provide direct parameter estimates of the regression model. Flexible nonparametric machine learning methods considerably mitigate the reliance on the parametric assumptions, but do not provide as naturally defined variable importance measure as the covariate effect native to parametric models. We investigate a general variable selection approach when both the covariates and outcomes can be missing at random and have general missing data patterns. This approach exploits the flexibility of machine learning modeling techniques and bootstrap imputation, which is amenable to nonparametric methods in which the covariate effects are not directly available. We conduct expansive simulations investigating the practical operating characteristics of the proposed variable selection approach, when combined with four tree-based machine learning methods, XGBoost, Random Forests, Bayesian Additive Regression Trees (BART) and Conditional Random Forests, and two commonly used parametric methods, lasso and backward stepwise selection. Numeric results suggest that when combined with bootstrap imputation, XGBoost and BART have the overall best variable selection performance with respect to the $F_1$ score and Type I error across various settings. In general, there is no significant difference in the variable selection performance due to imputation methods. We further demonstrate the methods via a case study of risk factors for 3-year incidence of metabolic syndrome with data from the Study of Women's Health Across the Nation.

Simultaneous variable selection and estimation in semiparametric regression of mixed panel count data

Variable Selection for Mixed Panel Count Data under the Proportional Mean Model.

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Simultaneous variable selection and parameters estimation for longitudinal data subject to missingness and covariates measurement error

Bayesian estimation for longitudinal data in a joint model with HPCs

Simultaneous variable selection in regression analysis of multivariate interval‐censored data

Mixed‐Effect Hybrid Models for Longitudinal Data with Nonignorable Dropout

Semiparametric least squares estimation of binary choice panel data models with endogeneity

Variable Selection for Longitudinal Data with High-Dimensional Covariates and Dropouts

Semiparametric Estimation Of Dynamic Binary Choice Panel Data Models

Bayesian variable selection in joint modeling of longitudinal data and interval-censored failure time data

SEMIPARAMETRIC LATENT-CLASS MODELS FOR MULTIVARIATE LONGITUDINAL AND SURVIVAL DATA

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Estimation with Unbalanced Panel Data Having Covariate Measurement Error

Estimation and Variable Selection for Semiparametric Transformation Models under a More Efficient Cohort Sampling Design

Variable selection for proportional hazards models with high‐dimensional covariates subject to measurement error

Simultaneous Mean and Covariance Estimation of Partially Linear Models for Longitudinal Data with Missing Responses and Covariate Measurement Error

Flexible variable selection in the presence of missing data

Estimation and variable selection in a joint model of survival times and longitudinal outcomes with random effects

Sieve estimation of the accelerated mean model based on panel count data

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning