Abstract:Experimental studies in biomedical research frequently pose analytical problems related to small sample size. In such studies, there are conflicting findings regarding the choice of parametric and nonparametric analysis, especially with non-normal data. In such instances, some methodologists questioned the validity of parametric tests and suggested nonparametric tests. In contrast, other methodologists found nonparametric tests to be too conservative and less powerful and thus preferred using parametric tests. Some researchers have recommended using a bootstrap test; however, this method also has small sample size limitation. We used a pooled method in nonparametric bootstrap test that may overcome the problem related with small samples in hypothesis testing. The present study compared nonparametric bootstrap test with pooled resampling method corresponding to parametric, nonparametric, and permutation tests through extensive simulations under various conditions and using real data examples. The nonparametric pooled bootstrap t-test provided equal or greater power for comparing two means as compared with unpaired t-test, Welch t-test, Wilcoxon rank sum test, and permutation test while maintaining type I error probability for any conditions except for Cauchy and extreme variable lognormal distributions. In such cases, we suggest using an exact Wilcoxon rank sum test. Nonparametric bootstrap paired t-test also provided better performance than other alternatives. Nonparametric bootstrap test provided benefit over exact Kruskal-Wallis test. We suggest using nonparametric bootstrap test with pooled resampling method for comparing paired or unpaired means and for validating the one way analysis of variance test results for non-normal data in small sample size studies. Copyright © 2017 John Wiley & Sons, Ltd.

A Parametric Bootstrap Approach for One-Way ANOVA Under Unequal Variances with Unbalanced Data.

Parametric Bootstrap Procedures for Three-Factor ANOVA and Multiple Comparison Procedures with Unequal Group Variances

Parametric Boostrap and Objective Bayesian Testing for Heteroscedastic One-Way ANOVA

A Parametric Bootstrap Test for Two-Way ANOVA Model Without Interaction Under Heteroscedasticity

Multiple Comparisons of Treatment Against Control under Unequal Variances Using Parametric Bootstrap

Bootstrap tests for simultaneous monotone ordering of effects in a two‐way ANOVA

Parametric and nonparametric bootstrap methods for general MANOVA

Analysis of small sample size studies using nonparametric bootstrap test with pooled resampling method

Testing against ordered alternatives in one-way ANOVA model with exponential errors

Heteroscedastic two-way ANOVA under constraints

Bootstrap Resampling Approaches for Repeated Measure Designs: Relative Robustness to Sphericity and Normality Violations

Simultaneous confidence intervals for pairwise multiple comparisons in a two-way unbalanced design with unequal variances

Bootstrap Inference for Panel Data Quantile Regression

Tests under simple order in one‐way ANCOVA

A fiducial-based approach to the one-way ANOVA in the presence of nonnormality and heterogeneous error variances

A bootstrap test for equality of variances

A bootstrap semiparametric homogeneity test for the distributions of multigroup proportional data, with applications to analysis of quality of life outcomes in clinical trials

High-dimensional MANOVA via Bootstrapping and its Application to Functional and Sparse Count Data

ANOVA and the variance homogeneity assumption: Exploring a better gatekeeper

Bootstrap Matching: a robust and efficient correction for non-random A/B test, and its applications

Bootstrapping Inference of Average Treatment Effect in Completely Randomized Experiments with High-Dimensional Covariates