Abstract:Objective: Existing approaches to fairness evaluation often overlook systematic differences in the social determinants of health, like demographics and socioeconomics, among comparison groups, potentially leading to inaccurate or even contradictory conclusions. This study aims to evaluate racial disparities in predicting mortality among patients with chronic diseases using a fairness detection method that considers systematic differences. Methods: We created five datasets from Mass General Brigham's electronic health records (EHR), each focusing on a different chronic condition: congestive heart failure (CHF), chronic kidney disease (CKD), chronic obstructive pulmonary disease (COPD), chronic liver disease (CLD), and dementia. For each dataset, we developed separate machine learning models to predict 1-year mortality and examined racial disparities by comparing prediction performances between Black and White individuals. We compared racial fairness evaluation between the overall Black and White individuals versus their counterparts who were Black and matched White individuals identified by propensity score matching, where the systematic differences were mitigated. Results: We identified significant differences between Black and White individuals in age, gender, marital status, education level, smoking status, health insurance type, body mass index, and Charlson comorbidity index (p-value < 0.001). When examining matched Black and White subpopulations identified through propensity score matching, significant differences between particular covariates existed. We observed weaker significance levels in the CHF cohort for insurance type (p = 0.043), in the CKD cohort for insurance type (p = 0.005) and education level (p = 0.016), and in the dementia cohort for body mass index (p = 0.041); with no significant differences for other covariates. When examining mortality prediction models across the five study cohorts, we conducted a comparison of fairness evaluations before and after mitigating systematic differences. We revealed significant differences in the CHF cohort with p-values of 0.021 and 0.001 in terms of F1 measure and Sensitivity for the AdaBoost model, and p-values of 0.014 and 0.003 in terms of F1 measure and Sensitivity for the MLP model, respectively. Discussion and conclusion: This study contributes to research on fairness assessment by focusing on the examination of systematic disparities and underscores the potential for revealing racial bias in machine learning models used in clinical settings.

Mitigating biases in feature selection and importance assessments in predictive models using LASSO regression

Mitigating Calibration Bias Without Fixed Attribute Grouping for Improved Fairness in Medical Imaging Analysis

Reevaluating feature importances in machine learning models for schizophrenia and bipolar disorder: The need for true associations

Feature selection methods and predictive models in CT lung cancer radiomics

Mitigating Diagnostic Errors in Lung Cancer Classification: A Multi-Eyes Principle to Uncertainty Quantification

Intelligent diagnosis of the severity of disease conditions in COVID-19 patients based on the LASSO method

Fair Diagnosis: Leveraging Causal Modeling to Mitigate Medical Bias

Machine Learning and Bias in Medical Imaging: Opportunities and Challenges

Towards Quantification of Bias in Machine Learning for Healthcare: A Case Study of Renal Failure Prediction

Optimal Machine Learning Methods for Radiomic Prediction Models: Clinical Application for Preoperative T2*-weighted Images of Cervical Spondylotic Myelopathy

Early and fair COVID-19 outcome risk assessment using robust feature selection

Repeated Sieving for Prediction Model Building with High-Dimensional Data

Using Machine Learning Algorithms Based on Patient Admission Laboratory Parameters to Predict Adverse Outcomes in COVID-19 Patients

Achieve Fairness without Demographics for Dermatological Disease Diagnosis

Exploring the value of multiple preprocessors and classifiers in constructing models for predicting microsatellite instability status in colorectal cancer

Generalized Methodology for Radiomic Feature Selection and Modeling in Predicting Clinical Outcomes.

Quantifying and leveraging predictive uncertainty for medical image assessment

Improving the Robustness of Variable Selection and Predictive Performance of Regularized Generalized Linear Models and Cox Proportional Hazard Models

Decoupling Inherent Risk and Early Cancer Signs in Image-based Breast Cancer Risk Models

Assessing fairness in machine learning models: A study of racial bias using matched counterparts in mortality prediction for patients with chronic diseases

Could the underlying biological basis of prognostic radiomics and deep learning signatures be explored in patients with lung cancer? A systematic review