Abstract:Algorithms that ensure reproducible findings from large-scale, high-dimensional data are pivotal in numerous signal processing applications. In recent years, multivariate false discovery rate (FDR) controlling methods have emerged, providing guarantees even in high-dimensional settings where the number of variables surpasses the number of samples. However, these methods often fail to reliably control the FDR in the presence of highly dependent variable groups, a common characteristic in fields such as genomics and finance. To tackle this critical issue, we introduce a novel framework that accounts for general dependency structures. Our proposed dependency-aware T-Rex selector integrates hierarchical graphical models within the T-Rex framework to effectively harness the dependency structure among variables. Leveraging martingale theory, we prove that our variable penalization mechanism ensures FDR control. We further generalize the FDR-controlling framework by stating and proving a clear condition necessary for designing both graphical and non-graphical models that capture dependencies. Additionally, we formulate a fully integrated optimal calibration algorithm that concurrently determines the parameters of the graphical model and the T-Rex framework, such that the FDR is controlled while maximizing the number of selected variables. Numerical experiments and a breast cancer survival analysis use-case demonstrate that the proposed method is the only one among the state-of-the-art benchmark methods that controls the FDR and reliably detects genes that have been previously identified to be related to breast cancer. An open-source implementation is available within the R package TRexSelector on CRAN.

High-dimensional Inference and FDR Control for Simulated Markov Random Fields

Directional FDR Control for Sub-Gaussian Sparse GLMs

Controlling the False Discovery Rate in Subspace Selection

Penalized Independence Rule for Testing High-Dimensional Hypotheses

High Dimensional Gaussian Copula Graphical Model with Fdr Control

False Discovery Rate Control for High-Dimensional Cox Model with Uneven Data Splitting

FDR Controlled Multiple Testing for Union Null Hypotheses: A Knockoff-based Approach

Scalable Inference of Sparsely-changing Markov Random Fields with Strong Statistical Guarantees

High-Dimensional False Discovery Rate Control for Dependent Variables

Parallelizable sampling of markov random fields

Controlling false discovery rate for mediator selection in high-dimensional data

Inference in High-dimensional Multivariate Response Regression with Hidden Variables

Empirical Bayes large-scale multiple testing for high-dimensional binary outcome data

Markov chain random fields, spatial Bayesian networks, and optimal neighborhoods for simulation of categorical fields

Private Estimation and Inference in High-Dimensional Regression with FDR Control

Estimating a Separably-Markov Random Field (SMuRF) from Binary Observations

Marginal false discovery rate control for likelihood-based penalized regression models

A Decorrelating and Debiasing Approach to Simultaneous Inference for High-Dimensional Confounded Models

Model-Free Statistical Inference on High-Dimensional Data

Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection

Simultaneous Inference for Non-Stationary Random Fields, with Application to Gridded Data Analysis