Abstract:Medical Decision Making, Ahead of Print. Objectives(1) To demonstrate the use of quality-adjusted life-years (QALYs) as an outcome measure for comparing performance between simulation models and identifying the most accurate model for economic evaluation and health technology assessment. QALYs relate directly to decision making and combine mortality and diverse clinical events into a single measure using evidence-based weights that reflect population preferences. (2) To explore the usefulness of Q2, the proportional reduction in error, as a model performance metric and compare it with other metrics: mean squared error (MSE), mean absolute error, bias (mean residual), and R2.MethodsWe simulated all EXSCEL trial participants (N = 14,729) using the UK Prospective Diabetes Study Outcomes Model software versions 1 (UKPDS-OM1) and 2 (UKPDS-OM2). The EXSCEL trial compared once-weekly exenatide with placebo (median 3.2-y follow-up). Default UKPDS-OM2 utilities were used to estimate undiscounted QALYs over the trial period based on the observed events and survival. These were compared with the QALYs predicted by UKPDS-OM1/2 for the same period.ResultsUKPDS-OM2 predicted patients' QALYs more accurately than UKPDS-OM1 did (MSE: 0.210 v. 0.253; Q2: 0.822 v. 0.786). UKPDS-OM2 underestimated QALYs by an average of 0.127 versus 0.150 for UKPDS-OM1. UKPDS-OM2 predictions were more accurate for mortality, myocardial infarction, and stroke, whereas UKPDS-OM1 better predicted blindness and heart disease. Q2 facilitated comparisons between subgroups and (unlike R2) was lower for biased predictors.ConclusionsQ2 for QALYs was useful for comparing global prediction accuracy (across all clinical events) of diabetes models. It could be used for model registries, choosing between simulation models for economic evaluation and evaluating the impact of recalibration. Similar methods could be used in other disease areas.HighlightsDiabetes simulation models are currently validated by examining their ability to predict the incidence of individual events (e.g., myocardial infarction, stroke, amputation) or composite events (e.g., first major adverse cardiovascular event).We introduce Q2, the proportional reduction in error, as a measure that may be useful for evaluating and comparing the prediction accuracy of econometric or simulation models.We propose using the Q2 or mean squared error for QALYs as global measures of model prediction accuracy when comparing diabetes models' performance for health technology assessment; these can be used to select the most accurate simulation model for economic evaluation and to evaluate the impact of model recalibration in diabetes or other conditions.

How Much Better is Faster? Empirical Tests of QALY Assumptions in Health-Outcome Sequences

Quality-adjusted life years, utility theory, and healthy-years equivalents

Measuring Effectiveness Based on Patient Experience (Instead of QALYs) in US Value Assessments

The Corrective Approach: Policy Implications of Recent Developments in QALY Measurement Based on Prospect Theory

Using QALYs as an Outcome for Assessing Global Prediction Accuracy in Diabetes Simulation Models

[Controversies around QALYs]

A Longer Life or a Quality Death? A Discrete Choice Experiment to Estimate the Relative Importance of Different Aspects of End-of-Life Care in the United Kingdom

WTP for a QALY and health states: More money for severer health states?

A stochastic framework for estimation of summary measures in cost-effectiveness analyses.

Review and Introduction of Quality Adjusted Life Years

Better Inpatient Health Quality at Lower Cost: Should I Participate in the Online Healthcare Community First?

Risk preferences over health: empirical estimates and implications for medical decision-making

Quantile regression and empirical likelihood for the analysis of longitudinal data with monotone missing responses due to dropout, with applications to quality of life measurements from clinical trials.

An elicitation of utility for quality of life under prospect theory

Estimating the Incremental Cost Per QALY Produced by the Spanish NHS: A Fixed-Effect Econometric Approach

Productivity and quality-adjusted life years: QALYs, PALYs and beyond

Quality- and productivity-adjusted life years: From QALYs to PALYs and beyond

Valuation of preference-based measures: can existing preference data be used to generate better estimates?

Head-to-Head Comparison of EQ-5D-3L and EQ-5D-5L Health Values

Analysis of Longitudinal Health-Related Quality of Life Data with Terminal Events

Estimating Taiwan's QALY league table for catastrophic illnesses: Providing real-world evidence to integrate prevention with treatment for resources allocation