Abstract:Statistical Methods in Medical Research, Ahead of Print. Factorial trials allow for the simultaneous evaluation of more than one treatment, by randomizing patients to their possible combinations, including control. However, the statistical power of one treatment can be influenced by the effectiveness of the other, a matter that has not been widely recognized. In this paper, we evaluate the relationship between the observed effectiveness of one treatment and the implied power for a second treatment in the same trial, under a range of conditions. We provide analytic and numerical solutions for a binary outcome, under the additive, multiplicative, and odds ratio scales for treatment interaction. We demonstrate how the minimum required sample size for a trial depends on the two treatment effects. Relevant factors include the event rate in the control group, sample size, treatment effect sizes, and Type-I error rate thresholds. We show that that power for one treatment decreases as a function of the observed effectiveness of the other treatment if there is no multiplicative interaction. A similar pattern is observed with the odds ratio scale at low control rates, but at high control rates, power may increase if the first treatment is moderately more effective than its planned value. When treatments do not interact additively, power may either increase or decrease, depending on the control event rate. We also determine where the maximum power occurs for the second treatment. We illustrate these ideas with data from two actual factorial trials. These results can benefit investigators in planning the analysis of factorial clinical trials, in particular, to alert them to the potential for losses in power when one observed treatment effect differs from its originally postulated value. Updating the power calculation and modifying the associated required sample size can then ensure sufficient power for both treatments.

Statistical Power for Estimating Treatment Effects Using Difference-in-Differences and Comparative Interrupted Time Series Estimators With Variation in Treatment Timing

Designing Difference-in-Difference Studies with Staggered Treatment Adoption: Key Concepts and Practical Guidelines

Difference-in-Differences Estimators of Intertemporal Treatment Effects

Simple Approaches to Nonlinear Difference-in-Differences with Panel Data

Understanding Difference-in-differences methods to evaluate policy effects with staggered adoption: an application to Medicaid and HIV

Difference-in-Differences Estimator of Quantile Treatment Effect on the Treated

A Semiparametric Instrumented Difference-in-Differences Approach to Policy Learning

Statistical power in parallel group point exposure studies with time-to-event outcomes: an empirical comparison of the performance of randomized controlled trials and the inverse probability of treatment weighting (IPTW) approach

Eliminating Systematic Bias from Difference-in-Differences Design: A Permutational Detrending Strategy

Revisiting Event-Study Designs: Robust and Efficient Estimation

Identifying and estimating effects of sustained interventions under parallel trends assumptions

Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods

Assessing Health Care Interventions via an Interrupted Time Series Model: Study Power and Design Considerations

Posterior predictive treatment assignment methods for causal inference in the context of time-varying treatments

The chained difference-in-differences

A Generalized Difference-in-Differences Estimator for Randomized Stepped-Wedge and Observational Staggered Adoption Settings

Tests for Many Treatment Effects in Regression Discontinuity Panel Data Models

Design and analysis of factorial clinical trials: The impact of one treatment's effectiveness on the statistical power and required sample size of the other

Fuzzy Differences-in-Differences

Difference-in-Differences Meets Tree-based Methods: Heterogeneous Treatment Effects Estimation with Unmeasured Confounding.

Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models