Abstract:Algorithms that ensure reproducible findings from large-scale, high-dimensional data are pivotal in numerous signal processing applications. In recent years, multivariate false discovery rate (FDR) controlling methods have emerged, providing guarantees even in high-dimensional settings where the number of variables surpasses the number of samples. However, these methods often fail to reliably control the FDR in the presence of highly dependent variable groups, a common characteristic in fields such as genomics and finance. To tackle this critical issue, we introduce a novel framework that accounts for general dependency structures. Our proposed dependency-aware T-Rex selector integrates hierarchical graphical models within the T-Rex framework to effectively harness the dependency structure among variables. Leveraging martingale theory, we prove that our variable penalization mechanism ensures FDR control. We further generalize the FDR-controlling framework by stating and proving a clear condition necessary for designing both graphical and non-graphical models that capture dependencies. Additionally, we formulate a fully integrated optimal calibration algorithm that concurrently determines the parameters of the graphical model and the T-Rex framework, such that the FDR is controlled while maximizing the number of selected variables. Numerical experiments and a breast cancer survival analysis use-case demonstrate that the proposed method is the only one among the state-of-the-art benchmark methods that controls the FDR and reliably detects genes that have been previously identified to be related to breast cancer. An open-source implementation is available within the R package TRexSelector on CRAN.

False discovery control for penalized variable selections with high-dimensional covariates.

Variable Selection via Adaptive False Negative Control in Linear Regression

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Faithful Variable Screening for High-Dimensional Convex Regression

Semi-Penalized Inference with Direct False Discovery Rate Control in High-Dimensions

Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression

Variable selection with false discovery rate control in deep neural networks

Marginal false discovery rate control for likelihood-based penalized regression models

Variable Selection for High-dimensional Cox Model with Error Rate Control

High-Dimensional False Discovery Rate Control for Dependent Variables

Joint testing and false discovery rate control in high-dimensional multivariate regression.

Feature‐specific inference for penalized regression using local false discovery rates

Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection

Controlling the False Discovery Rate in Subspace Selection

An Improved Variable Selection Procedure for Adaptive Lasso in High-Dimensional Survival Analysis.

Cellwise Outlier Detection with False Discovery Rate Control

Variable Selection for High Dimensional Gaussian Copula Regression Model: an Adaptive Hypothesis Testing Procedure.

False Variable Selection Rates in Regression

Optimal False Discovery Rate Control for Large Scale Multiple Testing with Auxiliary Information

Local False Discovery Rate Estimation with Competition-Based Procedures for Variable Selection