Abstract:Variable selection has been widely used in data analysis for the past decades, and it becomes increasingly important in the Big Data era as there are usually hundreds of variables available in a dataset. To enhance interpretability of a model, identifying potentially relevant features is often a step before fitting all the features into a regression model. A good variable selection method should effectively control the fraction of false discoveries and ensure large enough power of its selection set. In a lot of contemporary data applications, a great portion of features are coded as binary variables. Binary features are widespread in many fields, from online controlled experiments to genome science to physical statistics. Although there has recently been a handful of literature for provable false discovery rate (FDR) control in variable selection, most of the theoretical analyses were based on some strong dependency assumption or Gaussian assumption among features. In this paper we propose a variable selection method in regression framework for selecting binary features. Under mild conditions, we show that FDR is controlled exactly under a target level in a finite sample if the underlying distribution of the binary features is known. We show in simulations that FDR control is still attained when feature distribution is estimated from data. We also provide theoretical results on the power of our variables selection method in a linear regression model or a logistic regression model. In the restricted settings where competitors exist, we show in simulations and real data application on a HIV antiretroviral therapy dataset that our method has higher power than the competitor.

Variable Selection for High-dimensional Cox Model with Error Rate Control

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

High-dimensional variable selection for Cox's proportional hazards model

An Improved Variable Selection Procedure for Adaptive Lasso in High-Dimensional Survival Analysis.

Variable selection for proportional hazards models with high‐dimensional covariates subject to measurement error

Variable Selection for High Dimensional Gaussian Copula Regression Model: an Adaptive Hypothesis Testing Procedure.

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Variable selection for competing risk regression models: recommendations for analyzing data from epidemiological studies

Variable Selection for Generalized Linear Models with Interval-Censored Failure Time Data

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Variable selection in censored quantile regression with high dimensional data

False discovery control for penalized variable selections with high-dimensional covariates.

Variable Selection via Adaptive False Negative Control in Linear Regression

Robust variable selection methods with Cox model—a selective practical benchmark study

Rank-based Variable Selection with Censored Data

Stable variable selection for right censored data: comparison of methods

Variable selection for nonlinear Cox regression model via deep learning

Variable selection for accelerated lifetime models with synthesized estimation techniques

Variable selection via Group LASSO Approach : Application to the Cox Regression and frailty model

Variable selection with Group LASSO approach: Application to Cox regression with frailty model

Ensembling Variable Selectors by Stability Selection for the Cox Model