Abstract:In a multiple testing problem where one is willing to tolerate a few false rejections, procedure controlling the familywise error rate (FWER) can potentially be improved in terms of its ability to detect false null hypotheses by generalizing it to control the $k$-FWER, the probability of falsely rejecting at least $k$ null hypotheses, for some fixed $k>1$. Simes' test for testing the intersection null hypothesis is generalized to control the $k$-FWER weakly, that is, under the intersection null hypothesis, and Hochberg's stepup procedure for simultaneous testing of the individual null hypotheses is generalized to control the $k$-FWER strongly, that is, under any configuration of the true and false null hypotheses. The proposed generalizations are developed utilizing joint null distributions of the $k$-dimensional subsets of the $p$-values, assumed to be identical. The generalized Simes' test is proved to control the $k$-FWER weakly under the multivariate totally positive of order two (MTP$_2$) condition [J. Multivariate Analysis 10 (1980) 467--498] of the joint null distribution of the $p$-values by generalizing the original Simes' inequality. It is more powerful to detect $k$ or more false null hypotheses than the original Simes' test when the $p$-values are independent. A stepdown procedure strongly controlling the $k$-FWER, a version of generalized Holm's procedure that is different from and more powerful than [Ann. Statist. 33 (2005) 1138--1154] with independent $p$-values, is derived before proposing the generalized Hochberg's procedure. The strong control of the $k$-FWER for the generalized Hochberg's procedure is established in situations where the generalized Simes' test is known to control its $k$-FWER weakly.

Generalized P-Value in Two-Way ANOVA Models

A Parametric Bootstrap Test for Two-Way ANOVA Model Without Interaction Under Heteroscedasticity

Bayes Factors for Comparison of Two-Way ANOVA Models

Generalized spectral testing for multivariate continuous-time models

A Bayes factor with reasonable model selection consistency for ANOVA model

Heteroscedastic two-way ANOVA under constraints

Inferences on the difference and ratio of the means of two inverse Gaussian distributions

Combined p-value functions for meta-analysis

Inference Procedures on the Generalized Poisson Distribution from Multiple Samples: Comparisons with Nonparametric Models for Analysis of Covariance (ANCOVA) of Count Data

Improved Differentially Private Analysis of Variance

A fiducial-based approach to the one-way ANOVA in the presence of nonnormality and heterogeneous error variances

Generalized Sequential Probability Ratio Test for Separate Families of Hypotheses.

Sub-uniformity of harmonic mean p-values

Two-Way Partial AUC and Its Properties

Multiple testing of composite null hypotheses for discrete data using randomized $p$-values

Asymptotic permutation tests for coefficients of variation and standardised means in general one-way ANOVA models

Generalizing Simes' test and Hochberg's stepup procedure

A Change-Point Approach to Estimating the Proportion of False Null Hypotheses in Multiple Testing

Jewish Religious Ethics Mandate Access to Antiretroviral Drugs in Developing Countries

Approximate Power for Repeated-Measures ANOVA Lacking Sphericity

GIFTWD: A Prospect Theory-Based Generalized Intuitionistic Fuzzy Three-Way Decision Model