Abstract:OBJECTIVE: To compare the performance of two new approaches to risk adjustment that are free of the influence of observational intensity with methods that depend on diagnoses listed in administrative databases.SETTING: Administrative data from the US Medicare program for services provided in 2007 among 306 US hospital referral regions.DESIGN: Cross sectional analysis.PARTICIPANTS: 20% sample of fee for service Medicare beneficiaries residing in one of 306 hospital referral regions in the United States in 2007 (n = 5,153,877).MAIN OUTCOME MEASURES: The effect of health risk adjustment on age, sex, and race adjusted mortality and spending rates among hospital referral regions using four indices: the standard Centers for Medicare and Medicaid Services--Hierarchical Condition Categories (HCC) index used by the US Medicare program (calculated from diagnoses listed in Medicare's administrative database); a visit corrected HCC index (to reduce the effects of observational intensity on frequency of diagnoses); a poverty index (based on US census); and a population health index (calculated using data on incidence of hip fractures and strokes, and responses from a population based annual survey of health from the Centers for Disease Control and Prevention).RESULTS: Estimated variation in age, sex, and race adjusted mortality rates across hospital referral regions was reduced using the indices based on population health, poverty, and visit corrected HCC, but increased using the standard HCC index. Most of the residual variation in age, sex, and race adjusted mortality was explained (in terms of weighted R2) by the population health index: R2=0.65. The other indices explained less: R2=0.20 for the visit corrected HCC index; 0.19 for the poverty index, and 0.02 for the standard HCC index. The residual variation in age, sex, race, and price adjusted spending per capita across the 306 hospital referral regions explained by the indices (in terms of weighted R2) were 0.50 for the standard HCC index, 0.21 for the population health index, 0.12 for the poverty index, and 0.07 for the visit corrected HCC index, implying that only a modest amount of the variation in spending can be explained by factors most closely related to mortality. Further, once the HCC index is visit corrected it accounts for almost none of the residual variation in age, sex, and race adjusted spending.CONCLUSION: Health risk adjustment using either the poverty index or the population health index performed substantially better in terms of explaining actual mortality than the indices that relied on diagnoses from administrative databases; the population health index explained the majority of residual variation in age, sex, and race adjusted mortality. Owing to the influence of observational intensity on diagnoses from administrative databases, the standard HCC index over-adjusts for regional differences in spending. Research to improve health risk adjustment methods should focus on developing measures of risk that do not depend on observation influenced diagnoses recorded in administrative databases.

Re: Bias in Calculation of Attributable Fractions Using Relative Risks from Nonsmokers Only

Errors in the Calculation of the Population Attributable Fraction

Relative risks, the probability of necessity, and attributable fractions

Bias assessment and correction for Levin’s population attributable fraction in the presence of confounding

Estimating the Causal Effects of Smoking

Estimating and Forecasting the Smoking-Attributable Mortality Fraction for Both Genders Jointly in Over 60 Countries

The population-attributable fraction for time-dependent exposures and competing risks - A discussion on estimands

Calculating confidence intervals for impact numbers

Representative Pure Risk Estimation by Using Data from Epidemiologic Studies, Surveys, and Registries: Estimating Risks for Minority Subgroups

Emulating Causal Dose-Response Relations Between Air Pollutants and Mortality in the Medicare Population

A population health approach to reducing observational intensity bias in health risk adjustment: cross sectional analysis of insurance claims

Estimating the burden of occupational cancer: assessing bias and uncertainty

Reevaluating the fraction of cancer attributable to excess weight: overcoming the hidden impact of prediagnostic weight loss

Using Case Description Information to Reduce Sensitivity to Bias for the Attributable Fraction Among the Exposed

Emulating Causal Dose-Response Relations Between Air Pollutants and Mortality in Elders

An Integrated Risk Function for Estimating the Global Burden of Disease Attributable to Ambient Fine Particulate Matter Exposure

The built-in selection bias of hazard ratios formalized

A Comparison of Green, Delta, and Monte Carlo Methods to Select an Optimal Approach for Calculating the 95% Confidence Interval of the Population-attributable Fraction: Guidance for Epidemiological Research

Estimating long-term pollution exposure effects through inverse probability weighting methods with Cox proportional hazards models

The population-attributable fraction for time-dependent exposures using dynamic prediction and landmarking

A generalisation of the method of regression calibration and comparison with Bayesian and frequentist model averaging methods