Abstract:Variable selection has been widely used in data analysis for the past decades, and it becomes increasingly important in the Big Data era as there are usually hundreds of variables available in a dataset. To enhance interpretability of a model, identifying potentially relevant features is often a step before fitting all the features into a regression model. A good variable selection method should effectively control the fraction of false discoveries and ensure large enough power of its selection set. In a lot of contemporary data applications, a great portion of features are coded as binary variables. Binary features are widespread in many fields, from online controlled experiments to genome science to physical statistics. Although there has recently been a handful of literature for provable false discovery rate (FDR) control in variable selection, most of the theoretical analyses were based on some strong dependency assumption or Gaussian assumption among features. In this paper we propose a variable selection method in regression framework for selecting binary features. Under mild conditions, we show that FDR is controlled exactly under a target level in a finite sample if the underlying distribution of the binary features is known. We show in simulations that FDR control is still attained when feature distribution is estimated from data. We also provide theoretical results on the power of our variables selection method in a linear regression model or a logistic regression model. In the restricted settings where competitors exist, we show in simulations and real data application on a HIV antiretroviral therapy dataset that our method has higher power than the competitor.

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

False discovery control for penalized variable selections with high-dimensional covariates.

Variable Selection for High-dimensional Cox Model with Error Rate Control

Variable Selection for High Dimensional Gaussian Copula Regression Model: an Adaptive Hypothesis Testing Procedure.

Variable Selection via Adaptive False Negative Control in Linear Regression

Consistent variable selection via the optimal discovery procedure in multiple testing

Local False Discovery Rate Estimation with Competition-Based Procedures for Variable Selection

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Variable Selection and Identification of High-Dimensional Nonparametric Nonlinear Systems by Directional Regression

False Variable Selection Rates in Regression

Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection

Controlling the False Discovery Rate in Subspace Selection

False Discovery Rate Control for High-Dimensional Cox Model with Uneven Data Splitting

FDR Control and Power Analysis for High-Dimensional Logistic Regression Via StabKoff

A Transparent and Nonlinear Method for Variable Selection

Automatic Variable Selection for High-Dimensional Linear Models with Longitudinal Data

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

An Improved Variable Selection Procedure for Adaptive Lasso in High-Dimensional Survival Analysis.

Ultrahigh dimensional variable selection: beyond the linear model

Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression