Abstract:Experimental studies in biomedical research frequently pose analytical problems related to small sample size. In such studies, there are conflicting findings regarding the choice of parametric and nonparametric analysis, especially with non-normal data. In such instances, some methodologists questioned the validity of parametric tests and suggested nonparametric tests. In contrast, other methodologists found nonparametric tests to be too conservative and less powerful and thus preferred using parametric tests. Some researchers have recommended using a bootstrap test; however, this method also has small sample size limitation. We used a pooled method in nonparametric bootstrap test that may overcome the problem related with small samples in hypothesis testing. The present study compared nonparametric bootstrap test with pooled resampling method corresponding to parametric, nonparametric, and permutation tests through extensive simulations under various conditions and using real data examples. The nonparametric pooled bootstrap t-test provided equal or greater power for comparing two means as compared with unpaired t-test, Welch t-test, Wilcoxon rank sum test, and permutation test while maintaining type I error probability for any conditions except for Cauchy and extreme variable lognormal distributions. In such cases, we suggest using an exact Wilcoxon rank sum test. Nonparametric bootstrap paired t-test also provided better performance than other alternatives. Nonparametric bootstrap test provided benefit over exact Kruskal-Wallis test. We suggest using nonparametric bootstrap test with pooled resampling method for comparing paired or unpaired means and for validating the one way analysis of variance test results for non-normal data in small sample size studies. Copyright © 2017 John Wiley & Sons, Ltd.

Using bootstrap for statistical inference on random graphs

Bootstrap quantification of estimation uncertainties in network degree distributions

Snowboot: Bootstrap Methods for Network Inference

Bootstrap Inference for Panel Data Quantile Regression

A matrix completion bootstrap method for estimating scale-free network degree distribution

Wild bootstrap inference for penalized quantile regression for longitudinal data

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Cluster-Robust Bootstrap Inference in Quantile Regression Models

Bootstrap Inference for Hawkes and General Point Processes

The Big Data Bootstrap

Fast and Reliable Jackknife and Bootstrap Methods for Cluster‐Robust Inference

Statistical inference of random field auto-correlation structure from multiple sets of incomplete and sparse measurements using Bayesian compressive sampling-based bootstrapping

Estimating psychological networks and their accuracy: A tutorial paper

Bootstrap Methods for the Empirical Study of Decision-Making and Information Flows in Social Systems

Wild Bootstrap for Counting Process-Based Statistics

A Unified Bootstrap Test for Local Patterns of Spatiotemporal Association

Analysis of small sample size studies using nonparametric bootstrap test with pooled resampling method

Bootstrap Percolation on Spatial Networks

Bootstrapping Inference of Average Treatment Effect in Completely Randomized Experiments with High-Dimensional Covariates

Bootstrap percolation in inhomogeneous random graphs