Abstract:Importance: Medicare's Merit-Based Incentive Payment System (MIPS), a public reporting and pay-for-performance program, adjusts clinician payments based on publicly reported measures that are chosen primarily by clinicians or their practices. However, measure selection raises concerns that practices could earn bonuses or avoid penalties by selecting measures on which they already perform well, rather than by improving care-a form of gaming. This has prompted calls for mandatory reporting on a smaller set of measures including patient experiences. Objectives: Within precursor programs of the MIPS, this study examined 1) practices' selection of Consumer Assessment of Healthcare Providers and Systems (CAHPS) patient experience measures for quality scoring under pay-for-performance and 2) the association between mandated public reporting on CAHPS measures and performance on those measures. Design setting and participants: This study included 2 analyses. The first analysis examined the association between the baseline CAHPS scores of large practices (≥100 clinicians) and practices' selection of these measures for quality scoring under pay-for-performance up to 2 years later. The second analysis examined changes in patient experiences associated with a requirement that large practices publicly report CAHPS measures starting in 2014. A difference-in-differences analysis of 2012-2017 fee-for-service Medicare CAHPS data was conducted to compare changes in patient experiences between large practices (111-150 clinicians) that became subject to this reporting mandate and smaller unaffected practices (50-89 clinicians). Analyses were conducted between October 1, 2020 and July 30, 2021. Main outcomes and measures: CAHPS measures. Results: Among 301 large practices that publicly reported patient experience measures, the mean age of patients at baseline was 71.6 years (interquartile range [IQR] across practices: 70.4-73.2 years) and 55.8% of patients were female (IQR: 54.3%-57.7%). Large practices in the top vs. bottom quintile of patient experience scores at baseline were more likely to voluntarily include these scores in the pay-for-performance program two years later (96.3% vs. 67.9%), a difference of 28.4 percentage points (95% CI: 9.4,47.5 percentage points; P=0.004). After 2-3 years of the reporting mandate, patient experiences did not differentially improve in affected vs. unaffected practices (difference-in-differences estimate: -0.03 practice-level standard deviations of the composite score; 95% CI: -0.64,0.58; P=0.92). Conclusions: In this study of US physician practices that participated in precursors of the MIPS, large practices were found to select measures on which they were already performing well for a pay-for-performance program, consistent with gaming. However, mandating public reporting was not associated with improved patient experiences. These findings support recommendations to end optional measures in the MIPS but also suggest that public reporting on mandated measures may not improve care.

Measuring and Improving Performance of Clinicians: an Application of Patient-Based Records.

Performance Evaluation of Inpatient Service in Beijing: a Horizontal Comparison with Risk Adjustment Based on Diagnosis Related Groups

Research on Performance Evaluation of Clinical Physicians Based on Medical Big Data

Public Performance Metrics: Driving Physician Motivation and Performance

Measuring the Performance of Electronic Health Records: a Case Study in Residential Aged Care in Australia.

Relationships between job satisfaction, organizational commitment, burnout and job performance of healthcare professionals in a district-level health care system of Shenzhen, China

Which Contributes to Clinical Performance: Academic Output or Person–Environment Fit?

Implementation of the Observational Medical Outcomes Partnership Model in Electronic Medical Record Systems: Evaluation Study Using Factor Analysis and Decision-Making Trial and Evaluation Laboratory-Best-Worst Methods

Measuring the overall performance of mental healthcare providers

The effects of job satisfaction and psychological resilience on job performance among residents of the standardized residency training: a nationwide study in China

Predicting physician burnout using clinical activity logs: Model performance and lessons learned

Improvement of human performance in healthcare systems by taking into account physician behavior

Physician Wellness Measures and Clinical Performance on a Critically Ill Simulated Patient: Does a Lack of Well-Being Impact Patient Care?

Study on the determinants of health professionals' performance on diabetes management care in China

Application on Performance Evaluation in Clinical Department Management

A motivational factors assessment instrument for medication management center employees providing medication therapy management services: A Rasch analysis

Effects of the Performance Management Information System in Improving Performance: an Empirical Study in Shanghai Ninth People’s Hospital

Motivating factors on performance of primary care workers in China: a systematic review and meta-analysis

Exploration on index system of physician performance assessment in a tertiary hospital in Shanghai

Measuring performance in allied health professional role substitution models of care: a clinician survey

Changes in patient experiences and assessment of gaming among large clinician practices in precursors of the Merit-Based Incentive Payment System