Abstract:Algorithms that ensure reproducible findings from large-scale, high-dimensional data are pivotal in numerous signal processing applications. In recent years, multivariate false discovery rate (FDR) controlling methods have emerged, providing guarantees even in high-dimensional settings where the number of variables surpasses the number of samples. However, these methods often fail to reliably control the FDR in the presence of highly dependent variable groups, a common characteristic in fields such as genomics and finance. To tackle this critical issue, we introduce a novel framework that accounts for general dependency structures. Our proposed dependency-aware T-Rex selector integrates hierarchical graphical models within the T-Rex framework to effectively harness the dependency structure among variables. Leveraging martingale theory, we prove that our variable penalization mechanism ensures FDR control. We further generalize the FDR-controlling framework by stating and proving a clear condition necessary for designing both graphical and non-graphical models that capture dependencies. Additionally, we formulate a fully integrated optimal calibration algorithm that concurrently determines the parameters of the graphical model and the T-Rex framework, such that the FDR is controlled while maximizing the number of selected variables. Numerical experiments and a breast cancer survival analysis use-case demonstrate that the proposed method is the only one among the state-of-the-art benchmark methods that controls the FDR and reliably detects genes that have been previously identified to be related to breast cancer. An open-source implementation is available within the R package TRexSelector on CRAN.

Cellwise Outlier Detection with False Discovery Rate Control

High-Dimensional False Discovery Rate Control for Dependent Variables

False discovery rate control: Moving beyond the Benjamini–Hochberg method

Optimal False Discovery Rate Control for Large Scale Multiple Testing with Auxiliary Information

Controlling the False Discovery Rate in Subspace Selection

False discovery control for penalized variable selections with high-dimensional covariates.

Testing and Support Recovery of Multiple High-Dimensional Covariance Matrices with False Discovery Rate Control

False Discovery Rate Control via Data Splitting for Testing-after-Clustering

False Discovery Control in Multiple Testing: A Brief Overview of Theories and Methodologies

Local False Discovery Rate Estimation with Competition-Based Procedures for Variable Selection

Weak Signal Inclusion under Dependence and Applications in Genome-wide Association Study

Controlling the Rate of GWAS False Discoveries

False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation

False Discovery Rate Control for High-Dimensional Cox Model with Uneven Data Splitting

Directional false discovery rate control in large-scale multiple comparisons

Evaluating FDR and stratified FDR control approaches for high-throughput biological studies

FDR Controlled Multiple Testing for Union Null Hypotheses: A Knockoff-based Approach

A grouped, selectively weighted false discovery rate procedure

Asymptotic false discovery control of the Benjamini-Hochberg procedure for pairwise comparisons

Identifying the Complete Correlation Structure in Large-Scale High-Dimensional Data Sets with Local False Discovery Rates

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff