Abstract:In a multiple testing problem where one is willing to tolerate a few false rejections, procedure controlling the familywise error rate (FWER) can potentially be improved in terms of its ability to detect false null hypotheses by generalizing it to control the $k$-FWER, the probability of falsely rejecting at least $k$ null hypotheses, for some fixed $k>1$. Simes' test for testing the intersection null hypothesis is generalized to control the $k$-FWER weakly, that is, under the intersection null hypothesis, and Hochberg's stepup procedure for simultaneous testing of the individual null hypotheses is generalized to control the $k$-FWER strongly, that is, under any configuration of the true and false null hypotheses. The proposed generalizations are developed utilizing joint null distributions of the $k$-dimensional subsets of the $p$-values, assumed to be identical. The generalized Simes' test is proved to control the $k$-FWER weakly under the multivariate totally positive of order two (MTP$_2$) condition [J. Multivariate Analysis 10 (1980) 467--498] of the joint null distribution of the $p$-values by generalizing the original Simes' inequality. It is more powerful to detect $k$ or more false null hypotheses than the original Simes' test when the $p$-values are independent. A stepdown procedure strongly controlling the $k$-FWER, a version of generalized Holm's procedure that is different from and more powerful than [Ann. Statist. 33 (2005) 1138--1154] with independent $p$-values, is derived before proposing the generalized Hochberg's procedure. The strong control of the $k$-FWER for the generalized Hochberg's procedure is established in situations where the generalized Simes' test is known to control its $k$-FWER weakly.

Generalized Sequential Probability Ratio Test for Separate Families of Hypotheses.

Efficient three-stage $t$-tests

Asymptotic Optimality of Combined Double Sequential Weighted Probability Ratio Test for Three Composite Hypotheses

Asymptotic Optimality of Double Sequential Mixture Likelihood Ratio Test

Generalized FWER Control Procedures for Testing Multiple Hypotheses

Nearly Optimum Properties of Certain Multi-Decision Sequential Rules for General Non-i.i.d. Stochastic Models

Double Stepwise Likelihood Ratio Test for One-Sided Composite Hypotheses

Sequential Tests of Statistical Hypotheses with Confidence Limits

A Double Sequential Weighted Probability Ratio Test for One-Sided Composite Hypotheses

On the E ffi ciency of Generalized Likelihood Ratio Tests

Multiple-Testing Procedure Based on Generalized Inference of True Null Hypotheses Proportion

A Note for Likelihood Ratio Methods for Testing the Homogeneity of a Three-Sample Problem with a Mixture Structure

Testing Homogeneity of Inverse Gaussian Scale Parameters Based on Generalized Likelihood Ratio

Generalized Fiducial Methods for Testing the Homogeneity of a Three-Sample Problem with a Mixture Structure

Private Sequential Hypothesis Testing for Statisticians: Privacy, Error Rates, and Sample Size

A class of sequential multi-hypothesis tests

Sequential tests of multiple hypotheses controlling type I and II familywise error rates

Generalizing Simes' test and Hochberg's stepup procedure

Degenerate-Generalized Likelihood Ratio Test for One-Sided Composite Hypotheses

Asymptotic Expansions of the Distributions of Some Test Statistics in Generalized Linear Models

The Geometry of Generalized Likelihood Ratio Test.