Abstract:Clinical Trials, Ahead of Print. Background:Randomized controlled trials offer the best design for eliminating bias in estimating treatment effects but can be slow and costly in rare disease research. Additionally, an equal randomization approach may not be optimal in studies in which prior evidence of superiority of one or more treatments exist. Supplementing prospectively enrolled, concurrent controls with historical controls can reduce recruitment requirements and provide patients a higher likelihood of enrolling in a new and possibly superior treatment arm. Appropriate methods need to be employed to ensure comparability of concurrent and historical controls to minimize bias and variability in the treatment effect estimates and reduce the chances of drawing incorrect conclusions regarding treatment benefit.Methods:MILES was a phase III placebo-controlled trial employing 1:1 randomization that led to US Food and Drug Administration approval of sirolimus for treating patients with lymphangioleiomyomatosis. We re-analyzed the MILES trial data to learn whether substituting concurrent controls with controls from a historical registry could have accelerated subject enrollment while leading to similar study conclusions. We used propensity score matching to identify exchangeable historical controls from a registry balancing the baseline characteristics of the two control groups. This allowed more new patients to be assigned to the sirolimus arm. We used trial data and simulations to estimate key outcomes under an array of alternative designs.Results:Borrowing information from historical controls would have allowed the trial to enroll fewer concurrent controls while leading to the same conclusion reached in the trial. Simulations showed similar statistical performance for borrowing as for the actual trial design without producing type I error inflation and preserving power for the same study size when concurrent and historical controls are comparable.Conclusion:Substituting concurrent controls with propensity score–matched historical controls can allow more prospectively enrolled patients to be assigned to the active treatment and enable the trial to be conducted with smaller overall sample size, while maintaining covariate balance and study power and minimizing bias in response estimation. This approach does not fully eliminate the concern that introducing non-randomized historical controls in a trial may lead to bias in estimating treatment effects, and should be carefully considered on a case-by-case basis. Borrowing historical controls is best suited when conducting randomized controlled trials with conventional designs is challenging, as in rare disease research. High-quality data on covariates and outcomes must be available for candidate historical controls to ensure the validity of these designs. Additional precautions are needed to maintain blinding of the treatment assignment and to ensure comparability in the assessment of treatment safety.MILES ClinicalTrials.gov Number: NCT00414648.

Active Control Trials - Hypotheses and Issues*

Some Statistical Issues of Confirming Efficacy in Clinical Trials

BASIC: A Bayesian Adaptive Synthetic-Control Design for Phase II Clinical Trials.

Adaptive Hybrid Control Design for Comparative Clinical Trials with Historical Control Data

Synthetic and External Controls in Clinical Trials – A Primer for Researchers

Review of current controversial issues in clinical trials

Towards More Flexible False Positive Control in Phase III Randomized Clinical Trials

Comparison of methods for control allocation in multiple arm studies using response adaptive randomization

Considerations for master protocols using external controls

Estimating treatment effect in randomized trial after control to treatment crossover using external controls

Reverse Selection Designs for Accommodating Multiple Control Arms

Generalizing the intention-to-treat effect of an active control against placebo from historical placebo-controlled trials to an active-controlled trial: A case study of the efficacy of daily oral TDF/FTC in the HPTN 084 study

Use of Suboptimal Control Arms in Randomized Clinical Trials of Investigational Cancer Drugs in China, 2016-2021: an Observational Study

The tyranny of non-inferiority trials

Statistical approaches for the integration of external controls in a cystic fibrosis clinical trial: a simulation and an application

A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

Dynamic use of historical controls in clinical trials for rare disease research: A re-evaluation of the MILES trial

Applying the estimand and target trial frameworks to external control analyses using observational data: a case study in the solid tumor setting

Double blind: Double talk or are there ways to do better research

Causal progress with imperfect placebo treatments and outcomes

Design of platform trials with a change in the control treatment arm