Abstract:Phase-3 clinical trials provide the highest level of evidence on drug safety and effectiveness needed for market approval by implementing large randomized controlled trials (RCTs). However, 30-40% of these trials fail mainly because such studies have inadequate sample sizes, stemming from the inability to obtain accurate initial estimates of average treatment effect parameters. To remove this obstacle from the drug development cycle, we present a new algorithm called Trend-Adaptive Design with a Synthetic-Intervention-Based Estimator (TAD-SIE) that appropriately powers a parallel-group trial, a standard RCT design, by leveraging a state-of-the-art hypothesis testing strategy and a novel trend-adaptive design (TAD). Specifically, TAD-SIE uses SECRETS (Subject-Efficient Clinical Randomized Controlled Trials using Synthetic Intervention) for hypothesis testing, which simulates a cross-over trial in order to boost power; doing so, makes it easier for a trial to reach target power within trial constraints (e.g., sample size limits). To estimate sample sizes, TAD-SIE implements a new TAD tailored to SECRETS given that SECRETS violates assumptions under standard TADs. In addition, our TAD overcomes the ineffectiveness of standard TADs by allowing sample sizes to be increased across iterations without any condition while controlling significance level with futility stopping. On a real-world Phase-3 clinical RCT (i.e., a two-arm parallel-group superiority trial with an equal number of subjects per arm), TAD-SIE reaches typical target operating points of 80% or 90% power and 5% significance level in contrast to baseline algorithms that only get at best 59% power and 4% significance level.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the problem of insufficient sample size estimation in phase III randomized controlled trials (RCTs). Specifically, many phase III clinical trials fail due to insufficient sample size and cannot reach the target power and significance level. These problems mainly stem from the inaccuracy of the initial estimation of the average treatment effect parameters. To overcome this obstacle, the author proposes a new algorithm - Trend - Adaptive Design with a Synthetic - Intervention - Based Estimator (TAD - SIE), aiming to appropriately increase the sample size of parallel - group trials by using advanced hypothesis - testing strategies and novel trend - adaptive designs, thereby improving the success rate of the trials. ### Main Contributions 1. **Proposing the TAD - SIE Framework**: This framework solves the problem of sample size estimation in clinical parallel - group RCTs by using a new trend - adaptive algorithm and a powerful hypothesis - testing scheme (SECRETS). 2. **Verifying the Effectiveness of TAD - SIE**: The effect of TAD - SIE has been verified in actual phase III clinical RCTs, showing that it can reach typical target operating points (80% or 90% power and 5% significance level), while the standard baseline algorithm can only reach a maximum power of 59% and a significance level of 4%. 3. **Providing Sample - Efficient and Time - Efficient Modes**: TAD - SIE can select different modes according to the trial resource constraints to make a trade - off between the final sample size and the number of iterations. ### Solutions - **SECRETS Hypothesis Testing**: Use SECRETS to simulate crossover trials to improve trial power. - **Trend - Adaptive Design (TAD)**: Gradually increase the sample size and continuously optimize the estimates of the average treatment effect (ATE) and the outcome variance based on the accumulated RCT data to converge to the sample size required for the target power. - **Controlling the Significance Level**: Control the significance level by introducing a futility - stopping mechanism. - **Hyper - parameter Tuning**: Introduce a hyper - parameter to enable trial designers to make a trade - off between the final sample size and the number of algorithm iterations, thereby implementing sample - efficient or time - efficient solutions under given resource constraints. ### Formulas - **Sample Size Formula**: \[ n_a=\frac{(\sigma^2_{\text{control}}+\sigma^2_{\text{treat}})(z_{1 - \alpha/2}+z_{1 - \beta})^2}{\delta^2} \] where \(n_a\) is the sample size of each group, \(\sigma^2_{\text{control}}\) and \(\sigma^2_{\text{treat}}\) are the variances of the control group and the treatment group respectively, \(z_{1 - \alpha/2}\) and \(z_{1 - \beta}\) are the \((1-\alpha/2)\)th and \((1 - \beta)\)th percentiles of the standard normal distribution respectively, and \(\delta\) is the minimum clinically meaningful average treatment effect to be detected. - **Conditional Power (CP)**: \[ CP(t,z)=\Pr(Z > z_\alpha|t,z,\delta)=1-\Phi\left(\frac{z_\alpha - z\sqrt{t}-\delta(1 - t)}{\sqrt{1 - t}}\right) \] ### Conclusion TAD - SIE effectively solves the problem of insufficient sample size estimation in phase III trials by combining SECRETS and TAD, improving the success rate and efficiency of the trials. This method performs well in practical applications, especially in terms of resources.

TAD-SIE: Sample Size Estimation for Clinical Randomized Controlled Trials using a Trend-Adaptive Design with a Synthetic-Intervention-Based Estimator

SECRETS: Subject-Efficient Clinical Randomized Controlled Trials using Synthetic Intervention

BASIC: A Bayesian Adaptive Synthetic-Control Design for Phase II Clinical Trials.

AIDE: Adaptive intrapatient dose escalation designs to accelerate Phase I clinical trials

A Calibrated Power Prior Approach to Borrow Information from Historical Data with Application to Biosimilar Clinical Trials.

Seamless Phase II/III Design: a Useful Strategy to Reduce the Sample Size for Dose Optimization

A Bayesian Group Sequential Design for Randomized Biosimilar Clinical Trials with Adaptive Information Borrowing from Historical Data

A systematic approach to adaptive sequential design for clinical trials: using simulations to select a design with desired operating characteristics

An Adaptive Three‐Arm Comparative Clinical Endpoint Bioequivalence Study Design With Unblinded Sample Size Re‐Estimation and Optimized Allocation Ratio

A class of computational methods to reduce selection bias when designing Phase 3 clinical trials

Adaptive two-stage seamless sequential design for clinical trials

Controlling the type I error rate in two-stage sequential adaptive designs when testing for average bioequivalence

Conditional Power and Friends: The Why and How of (Un)planned, Unblinded Sample Size Recalculations in Confirmatory Trials

Data-driven Design of Randomized Control Trials with Guaranteed Treatment Effects

Sample size re-estimation in a superiority clinical trial using a hybrid classical and Bayesian procedure

Sample Size Calculation and Blinded Sample Size Recalculation in Clinical Trials Where the Treatment Effect is Measured by the Relative Risk

Learning for Dose Allocation in Adaptive Clinical Trials with Safety Constraints

Design and sample size determination for multiple‐dose randomized phase II trials for dose optimization

Simplification or simulation: Power calculation in clinical trials

Sample size considerations for comparing dynamic treatment regimens in a sequential multiple-assignment randomized trial with a continuous longitudinal outcome

Non-Inferiority and Equivalence Tests in A Sequential Multiple-Assignment Randomized Trial (SMART)