Abstract:Background: Most randomized controlled trials with a time-to-event outcome are designed assuming proportional hazards (PH) of the treatment effect. The sample size calculation is based on a logrank test. However, non-proportional hazards are increasingly common. At analysis, the estimated hazards ratio with a confidence interval is usually presented. The estimate is often obtained from a Cox PH model with treatment as a covariate. If non-proportional hazards are present, the logrank and equivalent Cox tests may lose power. To safeguard power, we previously suggested a 'joint test' combining the Cox test with a test of non-proportional hazards. Unfortunately, a larger sample size is needed to preserve power under PH. Here, we describe a novel test that unites the Cox test with a permutation test based on restricted mean survival time. Methods: We propose a combined hypothesis test based on a permutation test of the difference in restricted mean survival time across time. The test involves the minimum of the Cox and permutation test P-values. We approximate its null distribution and correct it for correlation between the two P-values. Using extensive simulations, we assess the type 1 error and power of the combined test under several scenarios and compare with other tests. We investigate powering a trial using the combined test. Results: The type 1 error of the combined test is close to nominal. Power under proportional hazards is slightly lower than for the Cox test. Enhanced power is available when the treatment difference shows an 'early effect', an initial separation of survival curves which diminishes over time. The power is reduced under a 'late effect', when little or no difference in survival curves is seen for an initial period and then a late separation occurs. We propose a method of powering a trial using the combined test. The 'insurance premium' offered by the combined test to safeguard power under non-PH represents about a single-digit percentage increase in sample size. Conclusions: The combined test increases trial power under an early treatment effect and protects power under other scenarios. Use of restricted mean survival time facilitates testing and displaying a generalized treatment effect.

Impact of the adjustment of stratification factors on time-to-event analyses

Consideration of stratification in confirmatory trials with time-to-event endpoint

Principal stratification analysis of noncompliance with time-to-event outcomes

Principal Stratification with Time-to-Event Outcomes

A Novel Stratified Analysis Method for Testing and Estimating Overall Treatment Effects on Time-to-Event Outcomes Using Average Hazard with Survival Weight

A stratification approach using logit-based models for confounder adjustment in the study of continuous outcomes

Estimation of ascertainment bias and its effect on power in clinical trials with time-to-event outcomes

Categorisation of continuous covariates for stratified randomisation: How should we adjust?

Statistical Considerations for Evaluating Treatment Effect under Various Non-proportional Hazard Scenarios

Prognostic Covariate Adjustment for Binary Outcomes Using Stratification

A two-step approach for analyzing time to event data under non-proportional hazards

Identifiability and estimation of causal effects by principal stratification with outcomes truncated by death

Augmenting the logrank test in the design of clinical trials in which non-proportional hazards of the treatment effect may be anticipated

Estimating effects of time-varying exposures on mortality risk

Non-collapsibility and Built-in Selection Bias of Hazard Ratio in Randomized Controlled Trials

Survival Analysis Using a 5-Step Stratified Testing and Amalgamation Routine in Randomized Clinical Trials

Alternative Analysis Methods for Time to Event Endpoints under Non-proportional Hazards: A Comparative Analysis

Alternative Analysis Methods for Time to Event Endpoints Under Nonproportional Hazards: A Comparative Analysis

Analysis of survival data with non-proportional hazards: A comparison of propensity score weighted methods

Stratified modestly-weighted log-rank tests in settings with an anticipated delayed separation of survival curves

Robust Design and Analysis of Clinical Trials With Non-proportional Hazards: A Straw Man Guidance from a Cross-pharma Working Group