Abstract:In many research fields, researchers aim to identify significant associations between a set of explanatory variables and a response while controlling the false discovery rate (FDR). To this aim, we develop a fully Bayesian generalization of the classical model-X knockoff filter. Knockoff filter introduces controlled noise in the model in the form of cleverly constructed copies of the predictors as auxiliary variables. In our approach we consider the joint model of the covariates and the response and incorporate the conditional independence structure of the covariates into the prior distribution of the auxiliary knockoff variables. We further incorporate the estimation of a graphical model among the covariates, which in turn aids knockoffs generation and improves the estimation of the covariate effects on the response. We use a modified spike-and-slab prior on the regression coefficients, which avoids the increase of the model dimension as typical in the classical knockoff filter. Our model performs variable selection using an upper bound on the posterior probability of non-inclusion. We show how our model construction leads to valid model-X knockoffs and demonstrate that the proposed characterization is sufficient for controlling the BFDR at an arbitrary level, in finite samples. We also show that the model selection is robust to the estimation of the precision matrix. We use simulated data to demonstrate that our proposal increases the stability of the selection with respect to classical knockoff methods, as it relies on the entire posterior distribution of the knockoff variables instead of a single sample. With respect to Bayesian variable selection methods, we show that our selection procedure achieves comparable or better performances, while maintaining control over the FDR. Finally, we show the usefulness of the proposed model with an application to real data.

Gene Hunting with Knockoffs for Hidden Markov Models

How Data Heterogeneity Affects Innovating Knowledge and Information in Gene Identification: A Statistical Learning Perspective

Deep Knockoffs

Nonparametric Bayesian Knockoff Generators for Feature Selection Under Complex Data Structure

Second-order group knockoffs with applications to genome-wide association studies

Knockoff Boosted Tree for Model-Free Variable Selection

Sequential knockoffs for continuous and categorical predictors: with application to a large Psoriatic Arthritis clinical trial pool

Bayesian Controlled FDR Variable Selection via Knockoffs

Functional knockoffs selection with applications to functional data analysis in high dimensions

Second-order group knockoffs with applications to GWAS

Improving the Stability of the Knockoff Procedure: Multiple Simultaneous Knockoffs and Entropy Maximization

Derandomized Truncated D-vine Copula Knockoffs with e-values to control the false discovery rate

Bayesian Nonparametric Variable Selection as an Exploratory Tool for Finding Genes that Matter

Searching for consistent associations with a multi-environment knockoff filter

Spatial Knockoff Bayesian Variable Selection in Genome-Wide Association Studies

Hidden Markov Model Variants and their Application

All that Glitters Is not Gold: Type‐I Error Controlled Variable Selection from Clinical Trial Data

Summary statistics knockoffs inference with family-wise error rate control

Variable Selection with the Knockoffs: Composite Null Hypotheses

BIGKnock: fine-mapping gene-based associations via knockoff analysis of biobank-scale data

An embedded gene selection method using knockoffs optimizing neural network