Abstract:Abstract Background Careful consideration and planning are required to establish “sufficient” evidence to ensure an investment in a larger, more well-powered behavioral intervention trial is worthwhile. In the behavioral sciences, this process typically occurs where smaller-scale studies inform larger-scale trials. Believing that one can do the same things and expect the same outcomes in a larger-scale trial that were done in a smaller-scale preliminary study (i.e., pilot/feasibility) is wishful thinking, yet common practice. Starting small makes sense, but small studies come with big decisions that can influence the usefulness of the evidence designed to inform decisions about moving forward with a larger-scale trial. The purpose of this commentary is to discuss what may constitute sufficient evidence for moving forward to a definitive trial. The discussion focuses on challenges often encountered when conducting pilot/feasibility studies, referred to as common (mis)steps, that can lead to inflated estimates of both feasibility and efficacy, and how the intentional design and execution of one or more, often small, pilot/feasibility studies can play a central role in developing an intervention that scales beyond a highly localized context. Main body Establishing sufficient evidence to support larger-scale, definitive trials, from smaller studies, is complicated. For any given behavioral intervention, the type and amount of evidence necessary to be deemed sufficient is inherently variable and can range anywhere from qualitative interviews of individuals representative of the target population to a small-scale randomized trial that mimics the anticipated larger-scale trial. Major challenges and common (mis)steps in the execution of pilot/feasibility studies discussed are those focused on selecting the right sample size, issues with scaling, adaptations and their influence on the preliminary feasibility and efficacy estimates observed, as well as the growing pains of progressing from small to large samples. Finally, funding and resource constraints for conducting informative pilot/feasibility study(ies) are discussed. Conclusion Sufficient evidence to scale will always remain in the eye of the beholder. An understanding of how to design informative small pilot/feasibility studies can assist in speeding up incremental science (where everything needs to be piloted) while slowing down premature scale-up (where any evidence is sufficient for scaling).

Sample size planning for pilot studies

Considerations in determining sample size for pilot studies

A simple formula for the calculation of sample size in pilot studies

A brief overview of pilot studies and their sample size justification

Sample Size for Pilot Studies and Precision Driven Experiments

Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable

General considerations for sample size estimation in animal study

Sample size determination for external pilot cluster randomised trials with binary feasibility outcomes: a tutorial

Accounting for Pilot Study Uncertainty in Sample Size Determination of Randomized Controlled Trials

A tutorial on pilot studies: the what, why and how

Sample size determinations using logistic regression with pilot data

How to calculate sample size in animal and human studies

Preclinical pilot studies: Five common pitfalls and how to avoid them

Small studies, big decisions: the role of pilot/feasibility studies in incremental science and premature scale-up of behavioral interventions

Sample Size Estimation in Clinical Research

Sample size and performance estimation for biomarker combinations based on pilot studies with small sample sizes

Sample Size Calculation in Medical Research: A Primer

A Bayesian approach on sample size calculation for comparing means.

Sample size determination: A practical guide for health researchers

Sample Size Calculation in Clinical Trial and Animal Studies

Sample size estimation and power analysis for clinical research studies