Abstract:In this paper we consider the problem of multiple testing when the hypotheses are dependent. In most of the existing literature, either Bayesian or non-Bayesian, the decision rules mainly focus on the validity of the test procedure rather than actually utilizing the dependency to increase efficiency. Moreover, the decisions regarding different hypotheses are marginal in the sense that they do not depend upon each other directly. However, in realistic situations, the hypotheses are usually dependent, and hence it is desirable that the decisions regarding the dependent hypotheses are taken jointly. In this article we develop a novel Bayesian multiple testing procedure that coherently takes this requirement into consideration. Our method, which is based on new notions of error and non-error terms, substantially enhances efficiency by judicious exploitation of the dependence structure among the hypotheses. We prove that our method minimizes the posterior expected loss associated with a an additive "0-1" loss function, we also prove theoretical results on the relevant error probabilities, establishing the coherence and usefulness of our method. The optimal decision configuration is not available in closed form and we propose a novel and efficient simulated annealing algorithm for the purpose of optimization, which is also generically applicable to binary optimization problems. Numerical studies demonstrate that in dependent situations, our method performs significantly better than some existing popular conventional multiple testing methods, in terms of accuracy and power control. Moreover, application of our ideas to a real, spatial data set associated with radionuclide concentration in Rongelap islands yielded insightful results.

Estimation of Proportion of Null Hypotheses Under Dependence

Two New Estimators for the Proportion of True Null Hypotheses in Multiple Test

Estimating false discovery proportion in multiple comparison under dependency.

Estimating the proportion of true null hypotheses and adaptive false discovery rate control in discrete paradigm

Consistent estimation of the proportion of false nulls and FDR for adaptive multiple testing Normal means under weak dependence

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses

A Change-Point Approach to Estimating the Proportion of False Null Hypotheses in Multiple Testing

Robustness of multiple testing procedures against dependence

Estimating the number and effect sizes of non-null hypotheses

Penalized Independence Rule for Testing High-Dimensional Hypotheses

On False Discovery and Non‐discovery Proportions of the Dynamic Adaptive Procedure

Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing

Asymptotics in Multiple Hypotheses Testing under Dependence: beyond Normality

Non-marginal Decisions: A Novel Bayesian Multiple Testing Procedure

A New Multiple Testing Method in the Dependent Case

Bayesian Hypothesis Tests Using Nonparametric Statistics

Multiple testing under negative dependence

Asymptotic Uncertainty of False Discovery Proportion for Dependent $t$-Tests

Asymptotic uncertainty of false discovery proportion

A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions