Predictive Tools in Charity Care—Revenue vs Access

Christopher W. Goodman,Kelsey Chalmers

DOI: https://doi.org/10.1001/jamainternmed.2024.3564

2024-10-08

JAMA Internal Medicine

Abstract:This Viewpoint discusses possible outcomes of predictive analytic tool use in charity care determinations: hospital revenue and patient debt.

medicine, general & internal

What problem does this paper attempt to address?

Early Prediction of Post-acute Care Discharge Disposition Using Predictive Analytics: Preponing Prior Health Insurance Authorization Thus Reducing the Inpatient Length of Stay

Avishek Choudhury

DOI: https://doi.org/10.48550/arXiv.1812.10487

2018-12-28

Computers and Society

Abstract:Objective: A patient medical insurance coverage plays an essential role in determining the post-acute care (PAC) discharge disposition. The prior health insurance authorization process postpones the PAC discharge disposition, increases the inpatient length of stay, and effects patient health. Our study implements predictive analytics for the early prediction of the PAC discharge disposition to reduce the deferments caused by prior health insurance authorization, the inpatient length of stay and inpatient stay expenses. Methodology: We conducted a group discussion involving 25 patient care facilitators (PCFs) and two registered nurses (RNs) and retrieved 1600 patient data records from the initial nursing assessment and discharge notes to conduct a retrospective analysis of PAC discharge dispositions using predictive analytics. Results: The chi-squared automatic interaction detector (CHAID) algorithm enabled the early prediction of the PAC discharge disposition, accelerated the prior health insurance process, decreased the inpatient length of stay by an average of 22.22%, and reduced inpatient stay expenses by \$1,974 for state government hospitals, \$2,346 for non-profit hospitals and \$1,798 for for-profit hospitals per day. The CHAID algorithm produced an overall accuracy of 84.16% and an area under the receiver operating characteristic (ROC) curve value of 0.81. Conclusion: The early prediction of PAC discharge dispositions can condense the PAC deferment caused by the prior health insurance authorization process and simultaneously minimize the inpatient length of stay and related expenses incurred by the hospital.
EHRs Connect Research and Practice: Where Predictive Modeling, Artificial Intelligence, and Clinical Decision Support Intersect

Casey Bennett,Tom Doub,Rebecca Selove

DOI: https://doi.org/10.1016/j.hlpt.2012.03.001

2012-04-23

Abstract:Objectives: Electronic health records (EHRs) are only a first step in capturing and utilizing health-related data - the challenge is turning that data into useful information. Furthermore, EHRs are increasingly likely to include data relating to patient outcomes, functionality such as clinical decision support, and genetic information as well, and, as such, can be seen as repositories of increasingly valuable information about patients' health conditions and responses to treatment over time. Methods: We describe a case study of 423 patients treated by Centerstone within Tennessee and Indiana in which we utilized electronic health record data to generate predictive algorithms of individual patient treatment response. Multiple models were constructed using predictor variables derived from clinical, financial and geographic data. Results: For the 423 patients, 101 deteriorated, 223 improved and in 99 there was no change in clinical condition. Based on modeling of various clinical indicators at baseline, the highest accuracy in predicting individual patient response ranged from 70-72% within the models tested. In terms of individual predictors, the Centerstone Assessment of Recovery Level - Adult (CARLA) baseline score was most significant in predicting outcome over time (odds ratio 4.1 + 2.27). Other variables with consistently significant impact on outcome included payer, diagnostic category, location and provision of case management services. Conclusions: This approach represents a promising avenue toward reducing the current gap between research and practice across healthcare, developing data-driven clinical decision support based on real-world populations, and serving as a component of embedded clinical artificial intelligences that "learn" over time.

Artificial Intelligence,Databases,Machine Learning
Cardiac catheterization laboratory inpatient forecast tool: a prospective evaluation

Matthew F Toerper,Eleni Flanagan,Sauleh Siddiqui,Jeff Appelbaum,Edward K Kasper,Scott Levin

DOI: https://doi.org/10.1093/jamia/ocv124

Abstract:Objective: To develop and prospectively evaluate a web-based tool that forecasts the daily bed need for admissions from the cardiac catheterization laboratory using routinely available clinical data within electronic medical records (EMRs). Methods: The forecast model was derived using a 13-month retrospective cohort of 6384 catheterization patients. Predictor variables such as demographics, scheduled procedures, and clinical indicators mined from free-text notes were input to a multivariable logistic regression model that predicted the probability of inpatient admission. The model was embedded into a web-based application connected to the local EMR system and used to support bed management decisions. After implementation, the tool was prospectively evaluated for accuracy on a 13-month test cohort of 7029 catheterization patients. Results: The forecast model predicted admission with an area under the receiver operating characteristic curve of 0.722. Daily aggregate forecasts were accurate to within one bed for 70.3% of days and within three beds for 97.5% of days during the prospective evaluation period. The web-based application housing the forecast model was used by cardiology providers in practice to estimate daily admissions from the catheterization laboratory. Discussion: The forecast model identified older age, male gender, invasive procedures, coronary artery bypass grafts, and a history of congestive heart failure as qualities indicating a patient was at increased risk for admission. Diagnostic procedures and less acute clinical indicators decreased patients' risk of admission. Despite the site-specific limitations of the model, these findings were supported by the literature. Conclusion: Data-driven predictive analytics may be used to accurately forecast daily demand for inpatient beds for cardiac catheterization patients. Connecting these analytics to EMR data sources has the potential to provide advanced operational decision support.
Assessing performance of ZCTA-level and Census Tract-level social and environmental risk factors in a model predicting hospital events

Morgan Henderson,Fei Han,Dillon Mahmoudi,Chad Perman,Howard Haft,Ian Stockwell,Leigh G. Goetschius

DOI: https://doi.org/10.1016/j.socscimed.2023.115943

2023-05-08

Abstract:Predictive analytics are used in primary care to efficiently direct health care resources to high-risk patients to prevent unnecessary health care utilization and improve health. Social determinants of health (SDOH) are important features in these models, but they are poorly measured in administrative claims data. Area-level SDOH can be proxies for unavailable individual-level indicators, but the extent to which the granularity of risk factors impacts predictive models is unclear. We examined whether increasing the granularity of area-based SDOH features from ZIP code tabulation area (ZCTA) to Census Tract strengthened an existing clinical prediction model for avoidable hospitalizations ( AH events) in Maryland Medicare fee-for-service beneficiaries. We created a person-month dataset for 465,749 beneficiaries (59.4% female; 69.8% White; 22.7% Black) with 144 features indexing medical history and demographics using Medicare claims (September 2018 through July 2021). Claims data were linked with 37 SDOH features associated with AH events from 11 publicly-available sources (e.g., American Community Survey) based on the beneficiaries' ZCTA and Census Tract of residence. Individual AH risk was estimated using six discrete time survival models with different combinations of demographic, condition/utilization, and SDOH features. Each model used stepwise variable selection to retain only meaningful predictors. We compared model fit, predictive performance, and interpretation across models. Results showed that increasing the granularity of area-based risk factors did not dramatically improve model fit or predictive performance. However, it did affect model interpretation by altering which SDOH features were retained during variable selection. Further, the inclusion of SDOH at either granularity level meaningfully reduced the risk that was attributed to demographic predictors (e.g., race, dual-eligibility for Medicaid). Differences in interpretation are critical given that this model is used by primary care staff to inform the allocation of care management resources, including those available to address drivers of health beyond the bounds of traditional health care.

public, environmental & occupational health,social sciences, biomedical
Implications of the Use of Artificial Intelligence Predictive Models in Health Care Settings : A Simulation Study

Akhil Vaid,Ashwin Sawant,Mayte Suarez-Farinas,Juhee Lee,Sanjeev Kaul,Patricia Kovatch,Robert Freeman,Joy Jiang,Pushkala Jayaraman,Zahi Fayad,Edgar Argulian,Stamatios Lerakis,Alexander W Charney,Fei Wang,Matthew Levin,Benjamin Glicksberg,Jagat Narula,Ira Hofer,Karandeep Singh,Girish N Nadkarni

DOI: https://doi.org/10.7326/M23-0949

Abstract:Background: Substantial effort has been directed toward demonstrating uses of predictive models in health care. However, implementation of these models into clinical practice may influence patient outcomes, which in turn are captured in electronic health record data. As a result, deployed models may affect the predictive ability of current and future models. Objective: To estimate changes in predictive model performance with use through 3 common scenarios: model retraining, sequentially implementing 1 model after another, and intervening in response to a model when 2 are simultaneously implemented. Design: Simulation of model implementation and use in critical care settings at various levels of intervention effectiveness and clinician adherence. Models were either trained or retrained after simulated implementation. Setting: Admissions to the intensive care unit (ICU) at Mount Sinai Health System (New York, New York) and Beth Israel Deaconess Medical Center (Boston, Massachusetts). Patients: 130 000 critical care admissions across both health systems. Intervention: Across 3 scenarios, interventions were simulated at varying levels of clinician adherence and effectiveness. Measurements: Statistical measures of performance, including threshold-independent (area under the curve) and threshold-dependent measures. Results: At fixed 90% sensitivity, in scenario 1 a mortality prediction model lost 9% to 39% specificity after retraining once and in scenario 2 a mortality prediction model lost 8% to 15% specificity when created after the implementation of an acute kidney injury (AKI) prediction model; in scenario 3, models for AKI and mortality prediction implemented simultaneously, each led to reduced effective accuracy of the other by 1% to 28%. Limitations: In real-world practice, the effectiveness of and adherence to model-based recommendations are rarely known in advance. Only binary classifiers for tabular ICU admissions data were simulated. Conclusion: In simulated ICU settings, a universally effective model-updating approach for maintaining model performance does not seem to exist. Model use may have to be recorded to maintain viability of predictive modeling. Primary funding source: National Center for Advancing Translational Sciences.
Predicting the Cost of Health Care Services: A Comparison of Case-mix Systems and Comorbidity Indices That Use Administrative Data

Xiaotong Huang,Sandra Peterson,Ruth Lavergne,Megan Ahuja,Kimberlyn McGrail

DOI: https://doi.org/10.1097/MLR.0000000000001247

Abstract:Background: Case-mix systems and comorbidity indices aggregate clinical information about patients over time and are used to characterize need for health care services. These tools were validated for their original purpose, but those purposes are varied, and they have not been compared directly in the context of predicting costs of health care services. Objective: To compare predictions of next-year health care service costs across 4 tools, including: the Johns Hopkins Adjusted Clinical Groups (ACG), the Elixhauser Comorbidity Index, Charlson-Deyo Comorbidity Index, and the Canadian Institute for Health Information (CIHI) population grouper. Methods: British Columbia administrative data from fiscal years 2012-2013 were used to generate case-mix variables and the comorbidity indices. Outcome variables include next-year (2013-2014) total, physician, acute care, and pharmaceutical costs, Outcomes were modeled using 2-part models. Performance was compared using adjusted R, root mean squared error, and mean absolute error using the predicted and the actual next-year cost. Results: Models including the CIHI grouper (239 conditions) and ACG system had similar performance in most cost categories and slightly better fit than Charlson Comorbidity Index (CCI) and Elixhauser Comorbidity Index (ECI). Adding a dummy variable for nonusers in the models for CCI and ECI increased R values slightly. Conclusions: All these systems have empirical support for use in predicting health care costs, despite in some cases being developed for other purposes. No system is particularly effective at predicting next-year acute care cost, likely because acute events are often by definition unexpected. The freely available ECI and CCI comorbidity indices implemented using the highest-performing methods developed here may be a good choice in many circumstances.
Building predictive models of healthcare costs with open healthcare data

A. Ravishankar Rao,Subrata Garai,Soumyabrata Dey,Hang Peng

DOI: https://doi.org/10.1109/ICHI48887.2020.9374348

2023-04-05

Abstract:Due to rapidly rising healthcare costs worldwide, there is significant interest in controlling them. An important aspect concerns price transparency, as preliminary efforts have demonstrated that patients will shop for lower costs, driving efficiency. This requires the data to be made available, and models that can predict healthcare costs for a wide range of patient demographics and conditions. We present an approach to this problem by developing a predictive model using machine-learning techniques. We analyzed de-identified patient data from New York State SPARCS (statewide planning and research cooperative system), consisting of 2.3 million records in 2016. We built models to predict costs from patient diagnoses and demographics. We investigated two model classes consisting of sparse regression and decision trees. We obtained the best performance by using a decision tree with depth 10. We obtained an R-square value of 0.76 which is better than the values reported in the literature for similar problems.

Machine Learning,Computers and Society
Targeting repetitive laboratory testing with electronic health records-embedded predictive decision support: A pre-implementation study

Naveed Rabbani,Stephen P Ma,Ron C Li,Marcy Winget,Susan Weber,Srinivasan Boosi,Tho D Pham,David Svec,Lisa Shieh,Jonathan H Chen

DOI: https://doi.org/10.1016/j.clinbiochem.2023.01.002

Abstract:Introduction: Unnecessary laboratory testing contributes to patient morbidity and healthcare waste. Despite prior attempts at curbing such overutilization, there remains opportunity for improvement using novel data-driven approaches. This study presents the development and early evaluation of a clinical decision support tool that uses a predictive model to help providers reduce low-yield, repetitive laboratory testing in hospitalized patients. Methods: We developed an EHR-embedded SMART on FHIR application that utilizes a laboratory test result prediction model based on historical laboratory data. A combination of semi-structured physician interviews, usability testing, and quantitative analysis on retrospective laboratory data were used to inform the tool's development and evaluate its acceptability and potential clinical impact. Key results: Physicians identified culture and lack of awareness of repeat orders as key drivers for overuse of inpatient blood testing. Users expressed an openness to a lab prediction model and 13/15 physicians believed the tool would alter their ordering practices. The application received a median System Usability Scale score of 75, corresponding to the 75th percentile of software tools. On average, physicians desired a prediction certainty of 85% before discontinuing a routine recurring laboratory order and a higher certainty of 90% before being alerted. Simulation on historical lab data indicates that filtering based on accepted thresholds could have reduced ∼22% of repeat chemistry panels. Conclusions: The use of a predictive algorithm as a means to calculate the utility of a diagnostic test is a promising paradigm for curbing laboratory test overutilization. An EHR-embedded clinical decision support tool employing such a model is a novel and acceptable intervention with the potential to reduce low-yield, repetitive laboratory testing.
How patients distinguish between clinical and administrative predictive models in health care

Paige Nong,Julia Adler-Milstein,Jodyn Platt

DOI: https://doi.org/10.37765/ajmc.2024.89484

2024-01-01

The American Journal of Managed Care

Abstract:OBJECTIVES: To understand patient perceptions of specific applications of predictive models in health care.STUDY DESIGN: Original, cross-sectional national survey.METHODS: We conducted a national online survey of US adults with the National Opinion Research Center from November to December 2021. Measures of internal consistency were used to identify how patients differentiate between clinical and administrative predictive models. Multivariable logistic regressions were used to identify relationships between comfort with various types of predictive models and patient demographics, perceptions of privacy protections, and experiences in the health care system.RESULTS: A total of 1541 respondents completed the survey. After excluding observations with missing data for the variables of interest, the final analytic sample was 1488. We found that patients differentiate between clinical and administrative predictive models. Comfort with prediction of bill payment and missed appointments was especially low (21.6% and 36.6%, respectively). Comfort was higher with clinical predictive models, such as predicting stroke in an emergency (55.8%). Experiences of discrimination were significant negative predictors of comfort with administrative predictive models. Health system transparency around privacy policies was a significant positive predictor of comfort with both clinical and administrative predictive models.CONCLUSIONS: Patients are more comfortable with clinical applications of predictive models than administrative ones. Privacy protections and transparency about how health care systems protect patient data may facilitate patient comfort with these technologies. However, larger inequities and negative experiences in health care remain important for how patients perceive administrative applications of prediction.

medicine, general & internal,health care sciences & services,health policy & services
Counterfactual Reasoning for Fair Clinical Risk Prediction

Stephen Pfohl,Tony Duan,Daisy Yi Ding,Nigam H. Shah

DOI: https://doi.org/10.48550/arXiv.1907.06260

IF: 5.414

2019-07-14

Machine Learning

Abstract:The use of machine learning systems to support decision making in healthcare raises questions as to what extent these systems may introduce or exacerbate disparities in care for historically underrepresented and mistreated groups, due to biases implicitly embedded in observational data in electronic health records. To address this problem in the context of clinical risk prediction models, we develop an augmented counterfactual fairness criteria to extend the group fairness criteria of equalized odds to an individual level. We do so by requiring that the same prediction be made for a patient, and a counterfactual patient resulting from changing a sensitive attribute, if the factual and counterfactual outcomes do not differ. We investigate the extent to which the augmented counterfactual fairness criteria may be applied to develop fair models for prolonged inpatient length of stay and mortality with observational electronic health records data. As the fairness criteria is ill-defined without knowledge of the data generating process, we use a variational autoencoder to perform counterfactual inference in the context of an assumed causal graph. While our technique provides a means to trade off maintenance of fairness with reduction in predictive performance in the context of a learned generative model, further work is needed to assess the generality of this approach.
Evaluating Patient Readmission Risk: A Predictive Analytics Approach

Avishek Choudhury,Christopher M Greene

DOI: https://doi.org/10.3844/ajeassp.2018.1320.1331

2019-08-21

Abstract:With the emergence of the Hospital Readmission Reduction Program of the Center for Medicare and Medicaid Services on October 1, 2012, forecasting unplanned patient readmission risk became crucial to the healthcare domain. There are tangible works in the literature emphasizing on developing readmission risk prediction models; However, the models are not accurate enough to be deployed in an actual clinical setting. Our study considers patient readmission risk as the objective for optimization and develops a useful risk prediction model to address unplanned readmissions. Furthermore, Genetic Algorithm and Greedy Ensemble is used to optimize the developed model constraints.

Computers and Society,Machine Learning
A Framework for Predicting Impactability of Healthcare Interventions Using Machine Learning Methods, Administrative Claims, Sociodemographic and App Generated Data

Heather Mattie,Patrick Reidy,Patrik Bachtiger,Emily Lindemer,Mohammad Jouni,Trishan Panch

DOI: https://doi.org/10.48550/arXiv.1905.00751

2019-05-15

Abstract:It is not clear how to target patients who are most likely to benefit from digital care management programs ex-ante, a shortcoming of current risk score based approaches. This study focuses on defining impactability by identifying those patients most likely to benefit from technology enabled care management, delivered through a digital health platform, including a mobile app and clinician web dashboard. Anonymized insurance claims data were used from a commercially insured population across several U.S. states and combined with inferred sociodemographic data and data derived from the patient-held mobile application itself. Our approach involves the creation of two models and the comparative analysis of the methodologies and performances therein. We first train a cost prediction model to calculate the differences in predicted (without intervention) versus actual (with onboarding onto digital health platform) healthcare expenditure for patients (N = 1,242). This enables the classification of impactability if differences in predicted versus actual costs meet a predetermined threshold. A random forest machine learning model was then trained to accurately categorize new patients as impactable versus not impactable, reaching an overall accuracy of 71.9%. We then modify these parameters through grid search to define the parameters that deliver optimal performance. A roadmap is proposed to iteratively improve the performance of the model. As the number of newly onboarded patients and length of use continues to increase, the accuracy of predicting impactability will improve commensurately as more advanced machine learning techniques such as deep learning become relevant. This approach is generalizable to analyzing the impactability of any intervention and is a key component of realising closed loop feedback systems for continuous improvement in healthcare.

Quantitative Methods,Machine Learning
Beyond the Bottom Line: Assessing Charity Care, Community Benefits, and Tax Exemptions in Nonprofit Hospitals

Hossein Zare,Gerard Anderson

DOI: https://doi.org/10.1097/jhm-d-24-00080

2024-11-20

Journal of Healthcare Management

Abstract:The wide range of charity care and community benefits spending and the value of tax exemptions ( Herring et al., 2018 ; Johnson et al., 2019 ; Lamboy-Ruiz et al., 2019 ) have raised many arguments about the lack of specificity on community benefits definitions and requirements established by federal, state, and local governments, as well as professional organizations ( James, 2016 ).

health policy & services
Promising algorithms to perilous applications: a systematic review of risk stratification tools for predicting healthcare utilisation

Christopher Oddy,Joe Zhang,Jessica Morley,Hutan Ashrafian

DOI: https://doi.org/10.1136/bmjhci-2024-101065

2024-06-19

Abstract:Objectives: Risk stratification tools that predict healthcare utilisation are extensively integrated into primary care systems worldwide, forming a key component of anticipatory care pathways, where high-risk individuals are targeted by preventative interventions. Existing work broadly focuses on comparing model performance in retrospective cohorts with little attention paid to efficacy in reducing morbidity when deployed in different global contexts. We review the evidence supporting the use of such tools in real-world settings, from retrospective dataset performance to pathway evaluation. Methods: A systematic search was undertaken to identify studies reporting the development, validation and deployment of models that predict healthcare utilisation in unselected primary care cohorts, comparable to their current real-world application. Results: Among 3897 articles screened, 51 studies were identified evaluating 28 risk prediction models. Half underwent external validation yet only two were validated internationally. No association between validation context and model discrimination was observed. The majority of real-world evaluation studies reported no change, or indeed significant increases, in healthcare utilisation within targeted groups, with only one-third of reports demonstrating some benefit. Discussion: While model discrimination appears satisfactorily robust to application context there is little evidence to suggest that accurate identification of high-risk individuals can be reliably translated to improvements in service delivery or morbidity. Conclusions: The evidence does not support further integration of care pathways with costly population-level interventions based on risk prediction in unselected primary care cohorts. There is an urgent need to independently appraise the safety, efficacy and cost-effectiveness of risk prediction systems that are already widely deployed within primary care.
Prediction of non emergent acute care utilization and cost among patients receiving Medicaid

Sadiq Y. Patel,Aaron Baum,Sanjay Basu

DOI: https://doi.org/10.1038/s41598-023-51114-z

IF: 4.6

2024-01-25

Scientific Reports

Abstract:Patients receiving Medicaid often experience social risk factors for poor health and limited access to primary care, leading to high utilization of emergency departments and hospitals (acute care) for non-emergent conditions. As programs proactively outreach Medicaid patients to offer primary care, they rely on risk models historically limited by poor-quality data. Following initiatives to improve data quality and collect data on social risk, we tested alternative widely-debated strategies to improve Medicaid risk models. Among a sample of 10 million patients receiving Medicaid from 26 states and Washington DC, the best-performing model tripled the probability of prospectively identifying at-risk patients versus a standard model (sensitivity 11.3% [95% CI 10.5, 12.1%] vs 3.4% [95% CI 3.0, 4.0%]), without increasing "false positives" that reduce efficiency of outreach (specificity 99.8% [95% CI 99.6, 99.9%] vs 99.5% [95% CI 99.4, 99.7%]), and with a ~ tenfold improved coefficient of determination when predicting costs (R 2 : 0.195–0.412 among population subgroups vs 0.022–0.050). Our best-performing model also reversed the lower sensitivity of risk prediction for Black versus White patients, a bias present in the standard cost-based model. Our results demonstrate a modeling approach to substantially improve risk prediction performance and equity for patients receiving Medicaid.

multidisciplinary sciences
Leveraging predictive analytics to target payer-led medication adherence interventions

Pankhuri Sharma

DOI: https://doi.org/10.37765/ajmc.2024.89610

Abstract:This article examines how predictive analytics can enhance payer initiatives to improve medication adherence. Despite its known impact on health outcomes and costs, medication nonadherence remains a widespread and persistent challenge in health care. Although payers are increasingly involved in addressing nonadherence, traditional approaches typically lead to suboptimal results due to their reactive nature and generic intervention. With improved access to data and more sophisticated machine learning tools, there is a growing opportunity for payers to use predictive analytics to stratify and target members at high risk, predict potential primary and secondary nonadherence, and preemptively intervene with tailored solutions. The potential benefit of this approach includes prevention, not only resolution, of nonadherence and leads to improved health outcomes, reduced health care costs, and increased member satisfaction. The article also discusses potential caveats to consider, such as data sharing, bias mitigation, and regulatory compliance, when implementing predictive analytics in this context.
Assessing Hospital Performance After Percutaneous Coronary Intervention Using Big Data

Jacob V Spertus,Sharon-Lise T Normand,Robert Wolf,Matt Cioffi,Ann Lovett,Sherri Rose

DOI: https://doi.org/10.1161/CIRCOUTCOMES.116.002826

Abstract:Background: Although risk adjustment remains a cornerstone for comparing outcomes across hospitals, optimal strategies continue to evolve in the presence of many confounders. We compared conventional regression-based model to approaches particularly suited to leveraging big data. Methods and results: We assessed hospital all-cause 30-day excess mortality risk among 8952 adults undergoing percutaneous coronary intervention between October 1, 2011, and September 30, 2012, in 24 Massachusetts hospitals using clinical registry data linked with billing data. We compared conventional logistic regression models with augmented inverse probability weighted estimators and targeted maximum likelihood estimators to generate more efficient and unbiased estimates of hospital effects. We also compared a clinically informed and a machine-learning approach to confounder selection, using elastic net penalized regression in the latter case. Hospital excess risk estimates range from -1.4% to 2.0% across methods and confounder sets. Some hospitals were consistently classified as low or as high excess mortality outliers; others changed classification depending on the method and confounder set used. Switching from the clinically selected list of 11 confounders to a full set of 225 confounders increased the estimation uncertainty by an average of 62% across methods as measured by confidence interval length. Agreement among methods ranged from fair, with a κ statistic of 0.39 (SE: 0.16), to perfect, with a κ of 1 (SE: 0.0). Conclusions: Modern causal inference techniques should be more frequently adopted to leverage big data while minimizing bias in hospital performance assessments.
A Novel Machine Learning Algorithm for Creating Risk-Adjusted Payment Formulas

Corinne Andriola,Randall P Ellis,Jeffrey J Siracuse,Alex Hoagland,Tzu-Chun Kuo,Heather E Hsu,Allan Walkey,Karen E Lasser,Arlene S Ash

DOI: https://doi.org/10.1001/jamahealthforum.2024.0625

2024-04-05

JAMA Health Forum

Abstract:Importance: Models predicting health care spending and other outcomes from administrative records are widely used to manage and pay for health care, despite well-documented deficiencies. New methods are needed that can incorporate more than 70 000 diagnoses without creating undesirable coding incentives. Objective: To develop a machine learning (ML) algorithm, building on Diagnostic Item (DXI) categories and Diagnostic Cost Group (DCG) methods, that automates development of clinically credible and transparent predictive models for policymakers and clinicians. Design, setting, and participants: DXIs were organized into disease hierarchies and assigned an Appropriateness to Include (ATI) score to reflect vagueness and gameability concerns. A novel automated DCG algorithm iteratively assigned DXIs in 1 or more disease hierarchies to DCGs, identifying sets of DXIs with the largest regression coefficient as dominant; presence of a previously identified dominating DXI removed lower-ranked ones before the next iteration. The Merative MarketScan Commercial Claims and Encounters Database for commercial health insurance enrollees 64 years and younger was used. Data from January 2016 through December 2018 were randomly split 90% to 10% for model development and validation, respectively. Deidentified claims and enrollment data were delivered by Merative the following November in each calendar year and analyzed from November 2020 to January 2024. Main outcome and measures: Concurrent top-coded total health care cost. Model performance was assessed using validation sample weighted least-squares regression, mean absolute errors, and mean errors for rare and common diagnoses. Results: This study included 35 245 586 commercial health insurance enrollees 64 years and younger (65 901 460 person-years) and relied on 19 clinicians who provided reviews in the base model. The algorithm implemented 218 clinician-specified hierarchies compared with the US Department of Health and Human Services (HHS) hierarchical condition category (HCC) model's 64 hierarchies. The base model that dropped vague and gameable DXIs reduced the number of parameters by 80% (1624 of 3150), achieved an R2 of 0.535, and kept mean predicted spending within 12% ($3843 of $31 313) of actual spending for the 3% of people with rare diseases. In contrast, the HHS HCC model had an R2 of 0.428 and underpaid this group by 33% ($10 354 of $31 313). Conclusions and relevance: In this study, by automating DXI clustering within clinically specified hierarchies, this algorithm built clinically interpretable risk models in large datasets while addressing diagnostic vagueness and gameability concerns.
Payer perceptions and use of value assessment tools in the United States

Kimberly Westrich,Tasmina Hydery,Vyishali Dharbhamalla,Lisabeth Buelt,Candace Zheng,Victoria Loo,Jennifer Graff

DOI: https://doi.org/10.18553/jmcp.2023.29.5.582

2023-05-01

Journal of Managed Care & Specialty Pharmacy

Abstract:BACKGROUND: As the United States transitions toward value-based payment, value assessment tools to measure the value of health care interventions are emerging. As the field evolves, it is important to evaluate how these tools are influencing treatment and coverage decisions. OBJECTIVE: To examine payer perceptions and use of US value assessment tools and identify how these tools inform payer decision-making. METHODS: A double-blind, web-based survey was conducted from June to July 2022 to assess health care payers' perceptions and use of value assessment tools developed by the American Society of Clinical Oncology, Drug Pricing Lab, Institute for Clinical and Economic Review (ICER), Innovation and Value Initiative, and National Comprehensive Cancer Network. RESULTS: 51 respondents completed the survey. 86% of payers were familiar with at least 4 of 5 value assessment tools. Both ICER and National Comprehensive Cancer Network tools are perceived as very useful for informing formulary decisions (57% and 49%, respectively). When selecting a value assessment tool, payers identified the inclusion of appropriate metrics and outcomes (92%), comparative clinical effectiveness information (88%), and reliance on rigorous, unbiased methods (86%) to be very/extremely important. Payers reported the inclusion of the patient, provider, and societal perspectives as lower importance (32%, 31%, and 20% identify these elements as very/extremely important, respectively). Payers reported using ICER evidence reports to both expand and restrict coverage decisions. To advance more useful and relevant value assessment tools, payers identified the need for greater stakeholder awareness of existing tools, and some recommended that value assessors increase the volume of assessments conducted. CONCLUSIONS: US health care payers perceive select value assessment tools to be useful for informing health care decisions. As policy momentum behind value assessment builds, additional examination of value assessment tools is needed to inform appropriate application of value assessment in US health care decision-making. DISCLOSURES: This study was funded by Xcenda/AmerisourceBergen. Ms Buelt, Ms Loo, Ms Westrich, and Drs Hydery and Zheng report employment with Xcenda/AmerisourceBergen. Drs Dharbhamalla and Graff report employment with AMCP.

pharmacology & pharmacy,health care sciences & services
Patient Outcome Predictions Improve Operations at a Large Hospital Network

Liangyuan Na,Kimberly Villalobos Carballo,Jean Pauphilet,Ali Haddad-Sisakht,Daniel Kombert,Melissa Boisjoli-Langlois,Andrew Castiglione,Maram Khalifa,Pooja Hebbal,Barry Stein,Dimitris Bertsimas

DOI: https://doi.org/10.48550/arXiv.2305.15629

IF: 5.414

2023-05-25

Machine Learning

Abstract:Problem definition: Access to accurate predictions of patients' outcomes can enhance medical staff's decision-making, which ultimately benefits all stakeholders in the hospitals. A large hospital network in the US has been collaborating with academics and consultants to predict short-term and long-term outcomes for all inpatients across their seven hospitals. Methodology/results: We develop machine learning models that predict the probabilities of next 24-hr/48-hr discharge and intensive care unit transfers, end-of-stay mortality and discharge dispositions. All models achieve high out-of-sample AUC (75.7%-92.5%) and are well calibrated. In addition, combining 48-hr discharge predictions with doctors' predictions simultaneously enables more patient discharges (10%-28.7%) and fewer 7-day/30-day readmissions ($p$-value $<0.001$). We implement an automated pipeline that extracts data and updates predictions every morning, as well as user-friendly software and a color-coded alert system to communicate these patient-level predictions (alongside explanations) to clinical teams. Managerial implications: Since we have been gradually deploying the tool, and training medical staff, over 200 doctors, nurses, and case managers across seven hospitals use it in their daily patient review process. We observe a significant reduction in the average length of stay (0.67 days per patient) following its adoption and anticipate substantial financial benefits (between \$55 and \$72 million annually) for the healthcare system.

Predictive Tools in Charity Care—Revenue vs Access

Early Prediction of Post-acute Care Discharge Disposition Using Predictive Analytics: Preponing Prior Health Insurance Authorization Thus Reducing the Inpatient Length of Stay

EHRs Connect Research and Practice: Where Predictive Modeling, Artificial Intelligence, and Clinical Decision Support Intersect

Cardiac catheterization laboratory inpatient forecast tool: a prospective evaluation

Assessing performance of ZCTA-level and Census Tract-level social and environmental risk factors in a model predicting hospital events

Implications of the Use of Artificial Intelligence Predictive Models in Health Care Settings : A Simulation Study

Predicting the Cost of Health Care Services: A Comparison of Case-mix Systems and Comorbidity Indices That Use Administrative Data

Building predictive models of healthcare costs with open healthcare data

Targeting repetitive laboratory testing with electronic health records-embedded predictive decision support: A pre-implementation study

How patients distinguish between clinical and administrative predictive models in health care

Counterfactual Reasoning for Fair Clinical Risk Prediction

Evaluating Patient Readmission Risk: A Predictive Analytics Approach

A Framework for Predicting Impactability of Healthcare Interventions Using Machine Learning Methods, Administrative Claims, Sociodemographic and App Generated Data

Beyond the Bottom Line: Assessing Charity Care, Community Benefits, and Tax Exemptions in Nonprofit Hospitals

Promising algorithms to perilous applications: a systematic review of risk stratification tools for predicting healthcare utilisation

Prediction of non emergent acute care utilization and cost among patients receiving Medicaid

Leveraging predictive analytics to target payer-led medication adherence interventions

Assessing Hospital Performance After Percutaneous Coronary Intervention Using Big Data

A Novel Machine Learning Algorithm for Creating Risk-Adjusted Payment Formulas

Payer perceptions and use of value assessment tools in the United States

Patient Outcome Predictions Improve Operations at a Large Hospital Network