Abstract:Variable selection has been widely used in data analysis for the past decades, and it becomes increasingly important in the Big Data era as there are usually hundreds of variables available in a dataset. To enhance interpretability of a model, identifying potentially relevant features is often a step before fitting all the features into a regression model. A good variable selection method should effectively control the fraction of false discoveries and ensure large enough power of its selection set. In a lot of contemporary data applications, a great portion of features are coded as binary variables. Binary features are widespread in many fields, from online controlled experiments to genome science to physical statistics. Although there has recently been a handful of literature for provable false discovery rate (FDR) control in variable selection, most of the theoretical analyses were based on some strong dependency assumption or Gaussian assumption among features. In this paper we propose a variable selection method in regression framework for selecting binary features. Under mild conditions, we show that FDR is controlled exactly under a target level in a finite sample if the underlying distribution of the binary features is known. We show in simulations that FDR control is still attained when feature distribution is estimated from data. We also provide theoretical results on the power of our variables selection method in a linear regression model or a logistic regression model. In the restricted settings where competitors exist, we show in simulations and real data application on a HIV antiretroviral therapy dataset that our method has higher power than the competitor.

Variable selection with false discovery rate control in deep neural networks

Variable Selection via Adaptive False Negative Control in Linear Regression

False discovery control for penalized variable selections with high-dimensional covariates.

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression

An Ensemble Approach toward Automated Variable Selection for Network Anomaly Detection

Penalized Generative Variable Selection

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

Variable Selection for Multivariate Time Series Prediction with Neural Networks

Back-propagating Errors Through Artificial Neural Networks for Variable Selection

Deep neural networks for variable selection of higher-order nonparametric spatial autoregressive model

An Improved Variable Selection Procedure for Adaptive Lasso in High-Dimensional Survival Analysis.

Variable Selection for High-dimensional Cox Model with Error Rate Control

A Transparent and Nonlinear Method for Variable Selection

The Conditional Prediction Function: A Novel Technique to Control False Discovery Rate for Complex Models

Risk-Controlled Selective Prediction For Regression Deep Neural Network Models

Local False Discovery Rate Estimation with Competition-Based Procedures for Variable Selection

Multi-step Adaptive Elastic-Net: Reducing False Positives in High-Dimensional Variable Selection

Robust inference via knockoffs

False Variable Selection Rates in Regression

Robust inference with knockoffs