Abstract:The NonParametric Combination methodology (NPC) of dependent permutation tests allows the experimenter to face many complex multivariate testing problems and represents a convincing and powerful alternative to standard parametric methods. The main advantage of this approach lies in its flexibility in handling any type of variable (categorical and quantitative, with or without missing values) while at the same time taking dependencies among those variables into account without the need of modelling them. NPC methodology enables to deal with repeated measures, paired data, restricted alternative hypotheses, missing data (completely at random or not), high-dimensional and small sample size data. Hence, NPC methodology can offer a significant contribution to successful research in biomedical studies with several endpoints, since it provides reasonably efficient solutions and clear interpretations of inferential results. Pesarin F. Multivariate permutation tests: with application in biostatistics. Chichester-New York: John Wiley &Sons, 2001; Pesarin F, Salmaso L. Permutation tests for complex data: theory, applications and software. Chichester, UK: John Wiley &Sons, 2010. We focus on non-parametric permutation solutions to two real-case studies in ophthalmology, concerning complex-repeated measures problems. For each data set, different analyses are presented, thus highlighting characteristic aspects of the data structure itself. Our goal is to present different solutions to multivariate complex case studies, guiding researchers/readers to choose, from various possible interpretations of a problem, the one that has the highest flexibility and statistical power under a set of less stringent assumptions. MATLAB code has been implemented to carry out the analyses.

Permutation-based multiple testing when fitting many generalized linear models

New methods for multiple testing in permutation inference for the general linear model

Robust testing in generalized linear models by sign flipping score contributions

Advances on Permutation Multivariate Analysis of Variance for big data

Generalized Permutation Framework for Testing Model Variable Significance

Permutation Tests for Assessing Potential Non-Linear Associations between Treatment Use and Multivariate Clinical Outcomes

The Exchangeability Assumption for Permutation Tests of Multiple Regression Models: Implications for Statistics and Data Science

PERMUTOOLS: A MATLAB Package for Multivariate Permutation Testing

Multivariate quantile-based permutation tests with application to functional data

Inference in generalized linear models with robustness to misspecified variances

Robust non-parametric tests for complex-repeated measures problems in ophthalmology

Goodness-of-fit testing in high-dimensional generalized linear models

Testing generalized linear models with high-dimensional nuisance parameter.

An Adaptive Test on High-dimensional Parameters in Generalized Linear Models

The Classification Permutation Test: A Nonparametric Test for Equality of Multivariate Distributions

Permutation tests for the equality of covariance operators of functional data with applications to evolutionary biology

Functional Response Designs via the Analytic Permutation Test

Multiple two-sample testing under arbitrary covariance dependency with an application in imaging mass spectrometry

An Empirical Comparison of Parametric and Permutation Tests for Regression Analysis of Randomized Experiments

A Regularization-Based Adaptive Test for High-Dimensional Generalized Linear Models

A studentized permutation test in group sequential designs