Abstract:Many introductory statistics textbooks in education, psychology, and the social sciences consider the Friedman test to be a nonparametric counterpart of repeated-measures ANOVA, just as the Kruskal-Wallis test is a counterpart of oneway ANOVA. However, it is known in theoretical statistics that the Friedman test is a generalization of the sign test and possesses the modest statistical power of the sign test for normal as well as many nonnormal distributions. Although not familiar to researchers, another significance test that can be regarded as a nonparametric counterpart of repeated-measures ANOVA is a rank-transformation procedure, in which the usual parametric statistical analysis is performed on ranks replacing the original scores. In the present computer simulation study we compared the ordinary paired-samples Student t test, the Wilcoxon signed-ranks test, and the sign test for correlated samples from normal, uniform, mixed-normal, exponential, Laplace, and Cauchy distributions, for which the relative efficiency of the methods is known. We also compared repeated-measures ANOVA, repeated-measures ANOVA on ranks, and the Friedman test for k mutually correlated samples from the same distributions, where k = 2,3, and 4. Power functions revealed that the Friedman test performed like the sign test for all distributions, whereas ANOVA on ranks performed like the Wilcoxon test These comparisons emphasize that classification of these statistical tests in introductory textbooks should be revised and that more attention should be paid to the rank transformation concept.

Smoothing-inspired lack-of-fit tests based on ranks

Smoothed nonparametric tests and their properties

Data-driven goodness-of-fit tests

Smoothed nonparametric two-sample tests

Rank-Based Test for Partial Functional Linear Regression Models

Exact and efficient multivariate two-sample tests through generalized linear rank statistics

Doubly ranked tests of location for grouped functional data

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Rank-Based Procedures in Factorial Designs: Hypotheses about Nonparametric Treatment Effects

Efficiency and Robustness of Rosenbaum's Regression (Un)-Adjusted Rank-based Estimator in Randomized Experiments

Relative Power of the Wilcoxon Test, the Friedman Test, and Repeated-Measures ANOVA on Ranks

The uniform general signed rank test and its design sensitivity

Another Argument in Favour of Wilcoxon's Signed Rank Test

Nonparametric Rank Test for Nonlinearity Detection

A Rank-Based High-Dimensional Test for Equality of Mean Vectors

Testing weak nulls in matched observational studies

On Rosenbaum's Rank-based Matching Estimator

Semiparametrically Point-Optimal Hybrid Rank Tests for Unit Roots

Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Power Comparison between High Dimensional t-Test, Sign, and Signed Rank Tests

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model