Abstract:The missing data issue is ubiquitous in health studies. Variable selection in the presence of both missing covariates and outcomes is an important statistical research topic but has been less studied. Existing literature focuses on parametric regression techniques that provide direct parameter estimates of the regression model. Flexible nonparametric machine learning methods considerably mitigate the reliance on the parametric assumptions, but do not provide as naturally defined variable importance measure as the covariate effect native to parametric models. We investigate a general variable selection approach when both the covariates and outcomes can be missing at random and have general missing data patterns. This approach exploits the flexibility of machine learning modeling techniques and bootstrap imputation, which is amenable to nonparametric methods in which the covariate effects are not directly available. We conduct expansive simulations investigating the practical operating characteristics of the proposed variable selection approach, when combined with four tree-based machine learning methods, XGBoost, Random Forests, Bayesian Additive Regression Trees (BART) and Conditional Random Forests, and two commonly used parametric methods, lasso and backward stepwise selection. Numeric results suggest that when combined with bootstrap imputation, XGBoost and BART have the overall best variable selection performance with respect to the $F_1$ score and Type I error across various settings. In general, there is no significant difference in the variable selection performance due to imputation methods. We further demonstrate the methods via a case study of risk factors for 3-year incidence of metabolic syndrome with data from the Study of Women's Health Across the Nation.

Regression Analysis with Individual-Specific Patterns of Missing Covariates

Imputations for High Missing Rate Data in Covariates Via Semi-supervised Learning Approach

A unified framework of analyzing missing data and variable selection using regularized likelihood

Efficient Quantile Regression Analysis with Missing Observations

Missing Data Imputation: Focusing on Single Imputation.

Sparse Linear Regression With Missing Data

Regression Analysis of Asynchronous Longitudinal Data with Informative Observation Processes

Missingness-Pattern-Adaptive Learning With Incomplete Data

Regression with Functional Errors-in-Predictors: A Generalized Method-of-Moments Approach

The More Data, the Better? Demystifying Deletion-Based Methods in Linear Regression with Missing Data

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

QUANTILE REGRESSION WITH COVARIATES MISSING AT RANDOM

Inference for Large Dimensional Factor Models under General Missing Data Patterns

Regression with an Imputed Dependent Variable

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

Simultaneous Nonparametric Regression Analysis of Sparse Longitudinal Data

On Locally Weighted Estimation and Hypothesis Testing of Varying-Coefficient Models with Missing Covariates

Regression with missing Ys: An improved strategy for analyzing multiply imputed data

Copula-based Regression Models with Data Missing at Random.

On the Relation between Prediction and Imputation Accuracy under Missing Covariates

Partial Replacement Imputation Estimation for Partially Linear Models with Complex Missing Pattern Covariates