Abstract:In the absence of population-based information, distribution-based meaningful change metrics have been previously found to perform similarly. Yet, it is unknown how a Bayesian approach derived from Posterior Predictive Distribution (PPD) of anticipated changes would compare against existing metrics. PPD defines meaningful change as change scores that exceed the amount expected from the posterior predictive distribution given a previous score. The PPD adjusts for common statistical phenomena that arise in a pre-test–post-test setting, such as regression to the mean and post-test drift. The PPD was compared to Reliable Change Index (RCI) and Gulliksen–Lord–Novick (GLN) methods using published real-world data and simulated hypothetical data, respectively. Real-world data showed that the methods made similar classifications when the measurement reliability was above 0.80. When reliability was low at 0.50 and thus more susceptible to regression to the mean effects, PPD and GLN were able to correct for it but not the RCI. However, PPD was more conservative and sensitive to biased priors. The simulation study showed that the three methods performed similarly overall, but PPD was slightly better in detecting prevalent changes, e.g., at time 2 (against RCI at p < 0.0001; against GLN at p < 0.0001) and time 3 (p = 0.024, p = 0.002). When measurement reliability is high, as is frequent in HRQOL development efforts, the three methods performed similarly. At a cost of more conservative cutoffs and complex calculations, the Bayesian PPD nevertheless confers practical advantages when reliability is low. It may be worthy of further research and applications.

Pre‐Posterior Distributions in Drug Development and Their Properties

Confidence distributions for treatment effects in clinical trials: Posteriors without priors

The distribution of power-related random variables (and their use in clinical trials)

Towards Treatment Effect Interpretability: A Bayesian Re-analysis of 194,129 Patient Outcomes Across 230 Oncology Trials

Estimating the Sampling Distribution of Posterior Decision Summaries in Bayesian Clinical Trials

Comparison of Dichotomized and Distributional Approaches in Rare Event Clinical Trial Design: a Fixed Bayesian Design

A Calibrated Power Prior Approach to Borrow Information from Historical Data with Application to Biosimilar Clinical Trials.

A Priori Determination of the Pretest Probability

Using an early outcome as the sole source of information of interim decisions regarding treatment effect on a long‐term endpoint: The non‐Gaussian case

Power Priors Based on Multiple Historical Studies for Binary Outcomes

Improving the assessment of the probability of success in late stage drug development

The Use of Posterior Predictive P-Values in Testing Goodness-Of-Fit

Statistical Decision Properties of Imprecise Trials Assessing COVID-19 Drugs

The posterior probability of a null hypothesis given a statistically significant result

Translating predictive distributions into informative priors

Optimality of testing procedures for survival data

Predictive Probabilities Made Simple: A Fast and Accurate Method for Clinical Trial Decision Making

Covariate-adjusted Group Sequential Comparisons of Survival Probabilities

Inferring Meaningful Change in Quality of Life with Posterior Predictive Distribution: an Alternative to Standard Error of Measurement

Stochastic curtailment tests for phase II trial with time-to-event outcome using the concept of relative time in the case of non-proportional hazards

Prior information for population pharmacokinetic and pharmacokinetic/pharmacodynamic analysis: overview and guidance with a focus on the NONMEM PRIOR subroutine