Abstract:Experimental studies in biomedical research frequently pose analytical problems related to small sample size. In such studies, there are conflicting findings regarding the choice of parametric and nonparametric analysis, especially with non-normal data. In such instances, some methodologists questioned the validity of parametric tests and suggested nonparametric tests. In contrast, other methodologists found nonparametric tests to be too conservative and less powerful and thus preferred using parametric tests. Some researchers have recommended using a bootstrap test; however, this method also has small sample size limitation. We used a pooled method in nonparametric bootstrap test that may overcome the problem related with small samples in hypothesis testing. The present study compared nonparametric bootstrap test with pooled resampling method corresponding to parametric, nonparametric, and permutation tests through extensive simulations under various conditions and using real data examples. The nonparametric pooled bootstrap t-test provided equal or greater power for comparing two means as compared with unpaired t-test, Welch t-test, Wilcoxon rank sum test, and permutation test while maintaining type I error probability for any conditions except for Cauchy and extreme variable lognormal distributions. In such cases, we suggest using an exact Wilcoxon rank sum test. Nonparametric bootstrap paired t-test also provided better performance than other alternatives. Nonparametric bootstrap test provided benefit over exact Kruskal-Wallis test. We suggest using nonparametric bootstrap test with pooled resampling method for comparing paired or unpaired means and for validating the one way analysis of variance test results for non-normal data in small sample size studies. Copyright © 2017 John Wiley & Sons, Ltd.

On Misuses of the Kolmogorov–Smirnov Test for One-Sample Goodness-of-Fit

Testing for Structural Breaks – A New Self-Normalization Approach Based on the Adjusted Sample Range

Kolmogorov–Smirnov Test: Overview

Goodness-of-Fit Tests for Large Datasets

Computing the Kolmogorov-Smirnov Distribution When the Underlying CDF is Purely Discrete, Mixed, or Continuous

A Stream-Suitable Kolmogorov-Smirnov-Type Test for Big Data Analysis

Kolmogorov-Smirnov type statistics for structural breaks - a new adjusted-range based self-normalization approach

From Poisson Observations to Fitted Negative Binomial Distribution

The Importance of Discussing Assumptions when Teaching Bootstrapping

Goodness-of-fit Testing in Linear Regression Models

Tests for the Equality of Two Distributions Based on Kolmgorov-Smirnov Statistic

Simulation Studies For Goodness-of-Fit and Two-Sample Methods For Univariate Data

A novel bootstrap goodness-of-fit test for normal linear regression models

Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models Via Nonparametric Regression

On the Robustness of Kernel Goodness-of-Fit Tests

A Kolmogorov–Smirnov-type test for the two-sample problem with left-truncated data

Minimax Optimal Goodness-of-Fit Testing with Kernel Stein Discrepancy

Analysis of small sample size studies using nonparametric bootstrap test with pooled resampling method

A New Bootstrap Goodness-of-Fit Test for Normal Linear Regression Models

KSD Aggregated Goodness-of-fit Test

Normality and significance testing in simple linear regression model for large sample sizes: a simulation study