Abstract:Background Clinical trials often include interim analyses of the proportion of participants experiencing an event by a fixed time-point. A pre-specified proportion excluded from a corresponding confidence interval (CI) may lead an independent monitoring committee to recommend stopping the trial. Frequently this cumulative proportion is estimated by the Kaplan-Meier estimator with a Wald approximate CI, which may have coverage issues with small samples. Methods We reviewed four alternative CI methods for cumulative proportions (Beta Product Confidence Procedure (BPCP), BPCP Mid P, Rothman-Wilson, Thomas-Grunkemeier) and two CI methods for simple proportions (Clopper-Pearson, Wilson). We conducted a simulation study comparing CI methods across true event proportions for 12 scenarios differentiated by sample sizes and censoring patterns. We re-analyzed interim data from A5340, a HIV cure trial considering the proportion of participants experiencing virologic failure. Results Our simulation study highlights the lower and upper tail error probabilities for each CI method. Across scenarios, we found differences in the performance of lower versus upper bounds. No single method is always preferred. The upper bound of a Wald approximate CI performed reasonably with some error inflation, whereas the lower bound of the BPCP Mid P method performed well. For a trial design similar to A5340, we recommend BPCP Mid P. Conclusions The design of future single-arm interim analyses of event proportions should consider the most appropriate CI method based on the relevant bound, anticipated sample size and event proportion. Our paper summarizes available methods, demonstrates performance in a simulation study, and includes code for implementation.

The Impact of Varying Patient Populations on the In-Control Performance of the Risk-Adjusted Cusum Chart

Cumulative sum charts for monitoring the COM-Poisson processes

Investigating the Impact of Ranked Set Sampling in Nonparametric Cusum Control Charts

In-control Robustness Comparison of Different Control Charts.

The Use of Probability Limits of COM–Poisson Charts and Their Applications

Guaranteed performance of individual control chart used in gamma passing rate-based patient-specific quality assurance

Parametric and nonparametric versions of adaptive CUSUM charts for monitoring the location of individual measurements

A likelihood-based adaptive CUSUM for monitoring linear drift of Poisson rate with time-varying sample sizes

Adaptive Hybrid Control Design for Comparative Clinical Trials with Historical Control Data

Risk adjustment-based statistical control charts with a functional covariate

CGR-CUSUM: a continuous time generalized rapid response cumulative sum chart

Nonparametric Adaptive CUSUM Chart for Detecting Arbitrary Distributional Changes

A new control chart based on proportional hazards and frailty regression models for monitoring high‐quality processes with censored observations

A risk-adjusted approach to monitoring surgery for survival outcomes based on a weighted score test

Adaptive EWMA and CUSUM charts with dynamic probability control limits

CUSUM and EWMA Control Charts for Negative Binomial Distribution

On the performance of CUSUM control charts for monitoring the coefficient of variation with measurement errors

An evaluation of confidence intervals for a cumulative proportion to enable decisions at interim reviews of single-arm trials

Effect of difference censored rates between groups in clinical trails

Multiple random change points in survival analysis with applications to clinical trials

A Statistical Method for Protocol Modifications With Heterogeneous Population Variances