Abstract:In a multiple testing problem where one is willing to tolerate a few false rejections, procedure controlling the familywise error rate (FWER) can potentially be improved in terms of its ability to detect false null hypotheses by generalizing it to control the $k$-FWER, the probability of falsely rejecting at least $k$ null hypotheses, for some fixed $k>1$. Simes' test for testing the intersection null hypothesis is generalized to control the $k$-FWER weakly, that is, under the intersection null hypothesis, and Hochberg's stepup procedure for simultaneous testing of the individual null hypotheses is generalized to control the $k$-FWER strongly, that is, under any configuration of the true and false null hypotheses. The proposed generalizations are developed utilizing joint null distributions of the $k$-dimensional subsets of the $p$-values, assumed to be identical. The generalized Simes' test is proved to control the $k$-FWER weakly under the multivariate totally positive of order two (MTP$_2$) condition [J. Multivariate Analysis 10 (1980) 467--498] of the joint null distribution of the $p$-values by generalizing the original Simes' inequality. It is more powerful to detect $k$ or more false null hypotheses than the original Simes' test when the $p$-values are independent. A stepdown procedure strongly controlling the $k$-FWER, a version of generalized Holm's procedure that is different from and more powerful than [Ann. Statist. 33 (2005) 1138--1154] with independent $p$-values, is derived before proposing the generalized Hochberg's procedure. The strong control of the $k$-FWER for the generalized Hochberg's procedure is established in situations where the generalized Simes' test is known to control its $k$-FWER weakly.

Efficient three-stage $t$-tests

A noniterative sample size procedure for tests based on t distributions

3-stage and 4-stage tests with deterministic stage sizes and non-iid data

Nearly Optimum Properties of Certain Multi-Decision Sequential Rules for General Non-i.i.d. Stochastic Models

M-Testing Using Finite and Infinite Dimensional Parameter Estimators

Simultaneous critical values for $t$-tests in very high dimensions

Optimal exact tests for multiple binary endpoints

A class of sequential multi-hypothesis tests

Generalizing Simes' test and Hochberg's stepup procedure

T-Friedman Test: A New Statistical Test for Multiple Comparison with an Adjustable Conservativeness Measure

Sequential tests of multiple hypotheses controlling type I and II familywise error rates

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model

Sequential Nonparametric Testing with the Law of the Iterated Logarithm

Generalized Sequential Probability Ratio Test for Separate Families of Hypotheses.

On the feasibility of parsimonious variable selection for Hotelling's $T^2$-test

A Family of Bayes Multiple Testing Procedures

Optimal exact tests for composite alternative hypotheses on cross tabulated data

A two-stage Fisher exact test for multi-arm studies with binary outcome variables

A Cramér Moderate Deviation Theorem for Hotelling’s $T^{2}$-Statistic with Applications to Global Tests

Extended MinP Tests for Global and Multiple testing

Finite sample t-tests for high-dimensional means