Abstract:Researchers often rely on analysis of variance (ANOVA) when they report results of experiments. To ensure a study is adequately powered to yield informative results when performing an ANOVA, researchers can perform an a-priori power analysis. However, power analysis for factorial ANOVA designs is often a challenge. Current software solutions do not allow power analyses for complex designs with several within-subject factors. Moreover, power analyses often need partial eta-squared or Cohen's $f$ as input, but these effect sizes are not intuitive and do not generalize to different experimental designs. We have created the R package Superpower and online Shiny apps to enable researchers without extensive programming experience to perform simulation-based power analysis for ANOVA designs of up to three within- or between-subject factors. Predicted effects are entered by specifying means, standard deviations, and for within-subject factors the correlations. The simulation provides the statistical power for all ANOVA main effects, interactions, and individual comparisons, and allows researchers to correct for multiple comparisons. The software can plot power across a range of sample sizes, can control error rates for multiple comparisons, and can compute power when the homogeneity or sphericity assumptions are violated. This tutorial will demonstrate how to perform a-priori power analysis to design informative studies for main effects, interactions, and individual comparisons, and highlights important factors that determine the statistical power for factorial ANOVA designs.

Two-Dimensional Plots for Interpreting Interactions in the Three-Factor Analysis of Variance Model

Understanding Factorial Designs, Main Effects, and Interaction Effects: Simply Explained with a Worked Example

The Analysis of Repeated Measures Designs Involving Multiple Dependent Variables

Understanding linear interaction analysis with causal graphs

Bayes Factors for Comparison of Two-Way ANOVA Models

Nearly Resolution V Plans on Blocks of Small Size

Linear multidimensional regression with interactive fixed-effects

A-ComVar: A Flexible Extension of Common Variance Design

Computer Programs for Robust Analyses in Multifactor Analysis of Variance Designs

A Tutorial on Testing, Visualizing, and Probing an Interaction Involving a Multicategorical Variable in Linear Regression Analysis

Interaction Balance for Symmetrical Factorial Designs with Generalized Minimum Aberration

Characterization of Three-Order Confounding Via Consulting Sets

Analysis of variance and the magnitude of effects: A general approach.

Investigation of Two Preliminary Analysis-Altering Elements: Ordinate Scaling and DPPXYR

Simulation-Based Power-Analysis for Factorial ANOVA Designs

Understanding one-way ANOVA using conceptual figures

Interpreting and Testing Interactions in Conditional Mixture Models

Simulation-Based Power Analysis for Factorial Analysis of Variance Designs

A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions

The monotonic linear model: Testing for removable interactions.

Displaying Variation in Large Datasets: Plotting a Visual Summary of Effect Sizes