Abstract:BACKGROUND: Common methods of benchmarking clinical performance rarely, if ever, account for admission source and, in particular, the effect of a patient being transferred from one medical center to another. Small biases in comparisons of observed versus expected deaths can substantially affect how high-quality institutions compare with peer hospitals. With the most sophisticated and validated set of case-mix measures available for patients, the intensive care unit is an ideal setting in which to study the effect of a patient's being transferred from another hospital.OBJECTIVE: To determine the extent of bias in benchmarking outcomes when performance measures do not account for transfer patients' greater severity of illness.DESIGN: Prospectively developed cohort study.SETTING: Medical intensive care unit (MICU) at a tertiary care university hospital.PATIENTS: 4579 consecutive admissions for 4208 patients from 1 January 1994 to 1 April 1998.MEASUREMENTS: MICU and hospital lengths of stay, MICU readmission, and hospital mortality rates.RESULTS: Compared with directly admitted patients, MICU patients transferred from another hospital had significantly higher Acute Physiology Scores at the time of admission and discharge (P = 0.001). Even after full adjustment for case mix and severity of illness, transfer patients had a 38% longer MICU stay (95% CI, 32% to 45%), a 41% longer hospital stay (CI, 34% to 50%), and a 2.2 times greater odds of hospital mortality (CI, 1.7 to 2.8) than directly admitted patients. With identical efficiency and quality, a referral hospital with a 25% MICU transfer rate compared with another with a 0% transfer rate would be penalized by 14 excess deaths per 1000 admissions when a benchmarking program adjusts only for case mix and severity of illness and not for the source of admission.CONCLUSIONS: In a setting with the most thorough diagnostic-based, case-mix adjustment and the most physiologically precise severity-of-illness information, accepting transfer patients can adversely affect efficiency and quality benchmarks. Benchmarking and profiling efforts beyond intensive care units must also recognize and account for this phenomenon; otherwise, referral centers may have an incentive to refuse care for patients who could benefit from being transferred to their facility.

Differences in case-mix can influence the comparison of standardised mortality ratios even with optimal risk adjustment: an analysis of data from paediatric intensive care

Evaluating Performance of Local Case-Mix System by International Comparison: a Case Study in Beijing, China.

Performance Evaluation of Inpatient Service in Beijing: a Horizontal Comparison with Risk Adjustment Based on Diagnosis Related Groups

Impact of case-mix on comparisons of patient-reported experience in NHS acute hospital trusts in England

Can we trust the standardized mortality ratio? A formal analysis and evaluation based on axiomatic requirements

Performance of Pediatric Risk of Mortality, Pediatric Index of Mortality and PIM2 in term Chinese neonates.

Should measures of patient experience in primary care be adjusted for case mix? Evidence from the English General Practice Patient Survey

Evaluating Prognostic Bias of Critical Illness Severity Scores Based on Age, Sex, and Primary Language in the United States: A Retrospective Multicenter Study.

Small Studies May Overestimate the Effect Sizes in Critical Care Meta-Analyses: A Meta-Epidemiological Study

Observational studies using propensity score analysis underestimated the effect sizes in critical care medicine.

Comparison of outcomes between children ventilated in a non‑paediatric intensive care and a paediatric intensive care unit: A retrospective analysis

Accepting Critically Ill Transfer Patients: Adverse Effect on a Referral Center's Outcome and Benchmark Measures

A multivariable analysis to predict variations in hospital mortality using systems-based factors of healthcare delivery to inform improvements to healthcare design within the English NHS

Comparison of Pediatric Risk of Mortality III, Pediatric Index of Mortality 2, and Pediatric Index of Mortality 3 in Predicting Mortality in a Pediatric Intensive Care Unit

Impact of Risk Adjustment for Socioeconomic Status on Risk-adjusted Surgical Readmission Rates.

Evaluating associations between patient-to-nurse ratios and mortality, process of care events and vital sign documentation on paediatric wards: a secondary analysis of data from the EPOCH cluster-randomised trial

Adjusting the risk-adjustment: Accounting for variation between organisations in the responsiveness of their expenditure to need

Interhospital Differences in the Use of Critical Care Therapies in Coronary Intensive Care Units and Its Association with In-Hospital Mortality: Insights from the Critical Care Cardiology Trials Network

Risk-adjusted monitoring of blood-stream infection in paediatric intensive care: a data linkage study

A New Standardized Mortality Ratio Method for Hospital Quality Evaluation

Evaluating effects of recent changes in NHS resource allocation policy on inequalities in amenable mortality in England, 2007–2014: time-series analysis