Abstract:Vast literature on experimental design extends from Fisher and Snedecor to the modern day. When data lies beyond the assumption of univariate normality, nonparametric methods including rank based statistics and permutation tests are enlisted. The permutation test is a versatile exact nonparametric significance test that requires drastically fewer assumptions than similar parametric tests. The main downfall of the permutation test is high computational cost making this approach laborious for complex data and sophisticated experimental designs and completely infeasible in any application requiring speedy results such as high throughput streaming data. We rectify this problem through application of concentration inequalities and thus propose a computation free permutation test -- i.e. a permutation-less permutation test. This general framework is applied to multivariate, matrix-valued, and functional data. We improve these concentration bounds via a novel incomplete beta transform. We extend our theory from 2-sample to $k$-sample testing through the use of weakly dependent Rademacher chaoses and modified decoupling inequalities. We test this methodology on classic functional data sets including the Berkeley growth curves and the phoneme dataset. We further consider analysis of spoken vowel sound under two experimental designs: the Latin square and the randomized block design.

Asymptotic permutation tests for coefficients of variation and standardised means in general one-way ANOVA models

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

Permutation Strategies for Inference in ANOVA‐Based Models for Nonorthogonal Designs Including Continuous Covariates

Advances on Permutation Multivariate Analysis of Variance for big data

Consistency of invariance-based randomization tests

Least Squares-Based Permutation Tests in Time Series

A studentized permutation test in group sequential designs

Multivariate quantile-based permutation tests with application to functional data

Testing against ordered alternatives in one-way ANOVA model with exponential errors

Functional repeated measures analysis of variance and its application

Permutation Tests for Regression, ANOVA, and Comparison of Signals: The permuco Package

Functional Response Designs via the Analytic Permutation Test

ANOVA and the variance homogeneity assumption: Exploring a better gatekeeper

Tests under simple order in one‐way ANCOVA

A fiducial-based approach to the one-way ANOVA in the presence of nonnormality and heterogeneous error variances

Variance Component Testing in Semiparametric Mixed Models

Permutation tests for the equality of covariance operators of functional data with applications to evolutionary biology

An Empirical Comparison of Parametric and Permutation Tests for Regression Analysis of Randomized Experiments

Permutation Tests for Assessing Potential Non-Linear Associations between Treatment Use and Multivariate Clinical Outcomes

Post-hoc and Anytime Valid Permutation and Group Invariance Testing

Generalized Permutation Framework for Testing Model Variable Significance