Abstract:Variable selection has been widely used in data analysis for the past decades, and it becomes increasingly important in the Big Data era as there are usually hundreds of variables available in a dataset. To enhance interpretability of a model, identifying potentially relevant features is often a step before fitting all the features into a regression model. A good variable selection method should effectively control the fraction of false discoveries and ensure large enough power of its selection set. In a lot of contemporary data applications, a great portion of features are coded as binary variables. Binary features are widespread in many fields, from online controlled experiments to genome science to physical statistics. Although there has recently been a handful of literature for provable false discovery rate (FDR) control in variable selection, most of the theoretical analyses were based on some strong dependency assumption or Gaussian assumption among features. In this paper we propose a variable selection method in regression framework for selecting binary features. Under mild conditions, we show that FDR is controlled exactly under a target level in a finite sample if the underlying distribution of the binary features is known. We show in simulations that FDR control is still attained when feature distribution is estimated from data. We also provide theoretical results on the power of our variables selection method in a linear regression model or a logistic regression model. In the restricted settings where competitors exist, we show in simulations and real data application on a HIV antiretroviral therapy dataset that our method has higher power than the competitor.

Variable Selection via Adaptive False Negative Control in Linear Regression

Faithful Variable Screening for High-Dimensional Convex Regression

False discovery control for penalized variable selections with high-dimensional covariates.

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Variable selection with false discovery rate control in deep neural networks

Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

A Transparent and Nonlinear Method for Variable Selection

Variable Selection for High-dimensional Cox Model with Error Rate Control

False Variable Selection Rates in Regression

Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection

Some Aspects of Response Variable Selection and Estimation in Multivariate Linear Regression

Post Selection Shrinkage Estimation for High Dimensional Data Analysis

Sparse Variable Selection Via Iteratively Reweighted Least Squares

A Novel Variable Selection Approach for Redundant Information Elimination Purpose of Process Control

Ultrahigh dimensional variable selection: beyond the linear model

An Improved Variable Selection Procedure for Adaptive Lasso in High-Dimensional Survival Analysis.

Bi-level variable selection via adaptive sparse group Lasso

EFFICIENT KERNEL-BASED VARIABLE SELECTION WITH SPARSISTENCY

New Robust Variable Selection Methods for Linear Regression Models

Variable Selection in a Class of Single-Index Models