Abstract:In many research fields, researchers aim to identify significant associations between a set of explanatory variables and a response while controlling the false discovery rate (FDR). To this aim, we develop a fully Bayesian generalization of the classical model-X knockoff filter. Knockoff filter introduces controlled noise in the model in the form of cleverly constructed copies of the predictors as auxiliary variables. In our approach we consider the joint model of the covariates and the response and incorporate the conditional independence structure of the covariates into the prior distribution of the auxiliary knockoff variables. We further incorporate the estimation of a graphical model among the covariates, which in turn aids knockoffs generation and improves the estimation of the covariate effects on the response. We use a modified spike-and-slab prior on the regression coefficients, which avoids the increase of the model dimension as typical in the classical knockoff filter. Our model performs variable selection using an upper bound on the posterior probability of non-inclusion. We show how our model construction leads to valid model-X knockoffs and demonstrate that the proposed characterization is sufficient for controlling the BFDR at an arbitrary level, in finite samples. We also show that the model selection is robust to the estimation of the precision matrix. We use simulated data to demonstrate that our proposal increases the stability of the selection with respect to classical knockoff methods, as it relies on the entire posterior distribution of the knockoff variables instead of a single sample. With respect to Bayesian variable selection methods, we show that our selection procedure achieves comparable or better performances, while maintaining control over the FDR. Finally, we show the usefulness of the proposed model with an application to real data.

FDR Control and Power Analysis for High-Dimensional Logistic Regression Via StabKoff

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Stab-GKnock: Controlled variable selection for partially linear models using generalized knockoffs

FDR Controlled Multiple Testing for Union Null Hypotheses: A Knockoff-based Approach

Revisiting Feature Selection for Linear Models with FDR and Power Guarantees

False Discovery Rate Control for High-Dimensional Cox Model with Uneven Data Splitting

FDR Control for Linear Log-Contrast Models with High-Dimensional Compositional Covariates

Bayesian Controlled FDR Variable Selection via Knockoffs

Functional knockoffs selection with applications to functional data analysis in high dimensions

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression

Residuals and Regression Diagnostics: Focusing on Logistic Regression

Controlling FDR in selecting group-level simultaneous signals from multiple data sources with application to the National Covid Collaborative Cohort data

CoxKnockoff: Controlled Feature Selection for the Cox Model Using Knockoffs

Variable Selection for High-dimensional Cox Model with Error Rate Control

The Conditional Prediction Function: A Novel Technique to Control False Discovery Rate for Complex Models

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Two-stage Hypothesis Tests for Variable Interactions with FDR Control

Directional FDR Control for Sub-Gaussian Sparse GLMs

Variable Selection via Adaptive False Negative Control in Linear Regression