Abstract:Personality and Social Psychology Review, Ahead of Print. Academic In the wake of the replication crisis, social and personality psychologists have increased attention to power analysis and the adequacy of sample sizes. In this article, we analyze current controversies in this area, including choosing effect sizes, why and whether power analyses should be conducted on already-collected data, how to mitigate the negative effects of sample size criteria on specific kinds of research, and which power criterion to use. For novel research questions, we advocate that researchers base sample sizes on effects that are likely to be cost-effective for other people to implement (in applied settings) or to study (in basic research settings), given the limitations of interest-based minimums or field-wide effect sizes. We discuss two alternatives to power analysis, precision analysis and sequential analysis, and end with recommendations for improving the practices of researchers, reviewers, and journal editors in social-personality psychology.Public Recently, social-personality psychology has been criticized for basing some of its conclusions on studies with low numbers of participants. As a result, power analysis, a mathematical way to ensure that a study has enough participants to reliably "detect" a given size of psychological effect, has become popular. This article describes power analysis and discusses some controversies about it, including how researchers should derive assumptions about effect size, and how the requirements of power analysis can be applied without harming research on hard-to-reach and marginalized communities. For novel research questions, we advocate that researchers base sample sizes on effects that are likely to be cost-effective for other people to implement (in applied settings) or to study (in basic research settings). We discuss two alternatives to power analysis, precision analysis and sequential analysis, and end with recommendations for improving the practices of researchers, reviewers, and journal editors in social-personality psychology.

Avoid Cohen’s ‘Small’, ‘Medium’, and ‘Large’ for Power Analysis

Tutorial: Small-N Power Analysis

Simulation-Based Power Analyses for the Smallest Effect Size of Interest: A Confidence-Interval Approach for Minimum-Effect and Equivalence Testing

How Many Participants Do We Have to Include in Properly Powered Experiments? A Tutorial of Power Analysis with Reference Tables

Evaluating Effect Size in Psychological Research: Sense and Nonsense

Power to Detect What? Considerations for Planning and Evaluating Sample Size

Causality in Statistical Power: Isomorphic Properties of Measurement, Research Design, Effect Size, and Sample Size

Effect Size Interpretation, Sample Size Calculation, and Statistical Power in Gerontology

Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction

How Big Is “Big”? Interpreting Effect Sizes in L2 Research

Interpreting Effect Sizes of Education Interventions

Simulation-Based Power Analysis for Factorial Analysis of Variance Designs

The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

Sample-Size Planning for More Accurate Statistical Power: A Method Adjusting Sample Effect Sizes for Publication Bias and Uncertainty

A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions

Power Analysis for Experiments with Clustered Data, Ratio Metrics, and Regression for Covariate Adjustment

Focus on Data: Statistical Design of Experiments and Sample Size Selection Using Power Analysis

On the estimation and interpretation of effect size metrics

Power Analysis and Sample Size Planning in ANCOVA Designs