Abstract:In this paper we consider the problem of multiple testing when the hypotheses are dependent. In most of the existing literature, either Bayesian or non-Bayesian, the decision rules mainly focus on the validity of the test procedure rather than actually utilizing the dependency to increase efficiency. Moreover, the decisions regarding different hypotheses are marginal in the sense that they do not depend upon each other directly. However, in realistic situations, the hypotheses are usually dependent, and hence it is desirable that the decisions regarding the dependent hypotheses are taken jointly. In this article we develop a novel Bayesian multiple testing procedure that coherently takes this requirement into consideration. Our method, which is based on new notions of error and non-error terms, substantially enhances efficiency by judicious exploitation of the dependence structure among the hypotheses. We prove that our method minimizes the posterior expected loss associated with a an additive "0-1" loss function, we also prove theoretical results on the relevant error probabilities, establishing the coherence and usefulness of our method. The optimal decision configuration is not available in closed form and we propose a novel and efficient simulated annealing algorithm for the purpose of optimization, which is also generically applicable to binary optimization problems. Numerical studies demonstrate that in dependent situations, our method performs significantly better than some existing popular conventional multiple testing methods, in terms of accuracy and power control. Moreover, application of our ideas to a real, spatial data set associated with radionuclide concentration in Rongelap islands yielded insightful results.

Equivalence testing for multiple groups

A Bayesian approach for evaluating equivalence over multiple groups, and comparison with frequentist tost

Equivalence Test in Multi-dimensional Space with Applications in A/B Testing

Non-marginal Decisions: A Novel Bayesian Multiple Testing Procedure

Multiple testing of interval composite null hypotheses using randomized p-values

Equivalence Testing: The Power of Bounded Adaptivity

A New Multiple Testing Method in the Dependent Case

Nonequivalence of measurement in latent variable modeling of multigroup data: A sensitivity analysis.

A Practitioner's Guide to Multiple Testing Error Rates

Impact of Sample Size and Variability on the Power and Type I Error Rates of Equivalence Tests: A Simulation Study.

A model of multiple hypothesis testing

More Powerful Multiple Testing in Randomized Experiments with Non-Compliance

Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

A Family of Bayes Multiple Testing Procedures

Tests for equivalence based on odds ratio for matched-pair design

Concomitant Group Testing

Unconditional Exact Tests for Equivalence or Noninferiority for Paired Binary Endpoints

General Frameworks for Conditional Two-Sample Testing

Optimal exact tests for multiple binary endpoints

Empirical Bayes Multistage Testing for Large-Scale Experiments

Efficiency in sequential testing: Comparing the sequential probability ratio test and the sequential Bayes factor test