Access to care improves EHR reliability and clinical risk prediction model performance

Anna Zink,Hongzhou Luan,Irene Y. Chen

2024-12-11

Abstract:Disparities in access to healthcare have been well-documented in the United States, but their effects on electronic health record (EHR) data reliability and resulting clinical models is poorly understood. Using an All of Us dataset of 134,513 participants, we investigate the effects of access to care on the medical machine learning pipeline, including medical condition rates, data quality, outcome label accuracy, and prediction performance. Our findings reveal that patients with cost constrained or delayed care have worse EHR reliability as measured by patient self-reported conditions for 78% of examined medical conditions. We demonstrate in a prediction task of Type II diabetes incidence that clinical risk predictive performance can be worse for patients without standard care, with balanced accuracy gaps of 3.6 and sensitivity gaps of 9.4 percentage points for those with cost-constrained or delayed care. We evaluate solutions to mitigate these disparities and find that including patient self-reported conditions improved performance for patients with lower access to care, with 11.2 percentage points higher sensitivity, effectively decreasing the performance gap between standard versus delayed or cost-constrained care. These findings provide the first large-scale evidence that healthcare access systematically affects both data reliability and clinical prediction performance. By revealing how access barriers propagate through the medical machine learning pipeline, our work suggests that improving model equity requires addressing both data collection biases and algorithmic limitations. More broadly, this analysis provides an empirical foundation for developing clinical prediction systems that work effectively for all patients, regardless of their access to care.

Computers and Society

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **How does the inequality in healthcare access affect the reliability of electronic health record (EHR) data and the performance of clinical risk prediction models?** Specifically, the author focuses on the following aspects: 1. **Impact on EHR data reliability**: - The author studied the impact of different levels of healthcare access (such as standard care, cost - constrained care, and delayed care) on the completeness of 37 self - reported health conditions recorded in EHR. They found that for patients who cannot obtain medical services in a timely manner due to economic reasons or scheduling problems, the missing rate of diagnostic information in their EHR is significantly higher. - For example, for common diseases such as depression and hypertension, the EHR missing rates in the low - access group are 64% and 47% respectively, while those in the high - access group are 60% and 41% respectively. 2. **Impact on clinical risk prediction model performance**: - The author evaluated the impact of different levels of healthcare access on prediction performance by constructing a model to predict the onset of type 2 diabetes within 2 years. The results showed that for patients with limited healthcare access, the performance of the prediction model is significantly worse. - Specifically, compared with the standard care group, the balanced accuracy rate in the cost - constrained care group and the delayed care group decreased by 3.6 percentage points respectively, and the sensitivity decreased by 9.4 percentage points respectively. 3. **Mitigation strategies**: - The author tried two methods to improve the prediction performance of these patients: - Adding "standard care" as a feature to the model, but this method has no significant impact on AUC, and only slightly improves the balanced accuracy rate and sensitivity in the delayed care group. - Adding self - reported health condition data as a feature to the model, which significantly improves the prediction performance in the cost - constrained care group and the delayed care group, especially the sensitivity is increased by 11.2 percentage points, almost eliminating the performance gap with the standard care group. ### Summary This study provides large - scale evidence for the first time, proving that the inequality in healthcare access not only affects the quality of EHR data, but also affects the performance of clinical risk prediction models built based on these data. The author suggests that in order to improve the fairness of the model, it is necessary to address data collection bias and algorithm limitations simultaneously, and consider incorporating patient - self - reported data into the model to improve the prediction effect.

Access to care improves EHR reliability and clinical risk prediction model performance

The impact of electronic health records (EHR) data continuity on prediction model fairness and racial-ethnic disparities

EHRs Connect Research and Practice: Where Predictive Modeling, Artificial Intelligence, and Clinical Decision Support Intersect

Improving Cardiovascular Risk Prediction Through Machine Learning Modelling of Irregularly Repeated Electronic Health Records

Assessing performance of ZCTA-level and Census Tract-level social and environmental risk factors in a model predicting hospital events

Prediction of non emergent acute care utilization and cost among patients receiving Medicaid

Evaluating the Impact of Social Determinants on Health Prediction in the Intensive Care Unit

Evaluating equity in performance of an electronic health record-based 6-month mortality risk model to trigger palliative care consultation: a retrospective model validation analysis

Assessing fairness in machine learning models: A study of racial bias using matched counterparts in mortality prediction for patients with chronic diseases

Fairness gaps in Machine learning models for hospitalization and emergency department visit risk prediction in home healthcare patients with heart failure

Conceptualizing bias in EHR data: A case study in performance disparities by demographic subgroups for a pediatric obesity incidence classifier

Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation

Disseminating the Risk Factors With Enhancement in Precision Medicine Using Comparative Machine Learning Models for Healthcare Data

Mining for equitable health: Assessing the impact of missing data in electronic health records

Intersectional consequences for marginal fairness in prediction models of emergency admissions

Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data

Development of a Social Risk Score in the Electronic Health Record to Identify Social Needs Among Underserved Populations: Retrospective Study

Assessment of sex and racial biases in electronic health records of emergency department patients with acute coronary syndrome

Race, Sex, and Age Disparities in the Performance of ECG Deep Learning Models Predicting Heart Failure

Machine Learning-Based Prediction for High Health Care Utilizers by Using a Multi-Institutional Diabetes Registry: Model Training and Evaluation

Assessing socioeconomic bias in machine learning algorithms in health care: a case study of the HOUSES index