Abstract:Background: The presence of bias in artificial intelligence has garnered increased attention, with inequities in algorithmic performance being exposed across the fields of criminal justice, education, and welfare services. In health care, the inequitable performance of algorithms across demographic groups may widen health inequalities. Objective: Here, we identify and characterize bias in cardiology algorithms, looking specifically at algorithms used in the management of heart failure. Methods: Stage 1 involved a literature search of PubMed and Web of Science for key terms relating to cardiac machine learning (ML) algorithms. Papers that built ML models to predict cardiac disease were evaluated for their focus on demographic bias in model performance, and open-source data sets were retained for our investigation. Two open-source data sets were identified: (1) the University of California Irvine Heart Failure data set and (2) the University of California Irvine Coronary Artery Disease data set. We reproduced existing algorithms that have been reported for these data sets, tested them for sex biases in algorithm performance, and assessed a range of remediation techniques for their efficacy in reducing inequities. Particular attention was paid to the false negative rate (FNR), due to the clinical significance of underdiagnosis and missed opportunities for treatment. Results: In stage 1, our literature search returned 127 papers, with 60 meeting the criteria for a full review and only 3 papers highlighting sex differences in algorithm performance. In the papers that reported sex, there was a consistent underrepresentation of female patients in the data sets. No papers investigated racial or ethnic differences. In stage 2, we reproduced algorithms reported in the literature, achieving mean accuracies of 84.24% (SD 3.51%) for data set 1 and 85.72% (SD 1.75%) for data set 2 (random forest models). For data set 1, the FNR was significantly higher for female patients in 13 out of 16 experiments, meeting the threshold of statistical significance (-17.81% to -3.37%; P<.05). A smaller disparity in the false positive rate was significant for male patients in 13 out of 16 experiments (-0.48% to +9.77%; P<.05). We observed an overprediction of disease for male patients (higher false positive rate) and an underprediction of disease for female patients (higher FNR). Sex differences in feature importance suggest that feature selection needs to be demographically tailored. Conclusions: Our research exposes a significant gap in cardiac ML research, highlighting that the underperformance of algorithms for female patients has been overlooked in the published literature. Our study quantifies sex disparities in algorithmic performance and explores several sources of bias. We found an underrepresentation of female patients in the data sets used to train algorithms, identified sex biases in model error rates, and demonstrated that a series of remediation techniques were unable to address the inequities present.

A Supervised Machine Learning Approach with Feature Selection for Sex-Specific Biomarker Prediction

Machine Learning Driven Biomarker Selection for Medical Diagnosis

Detecting Biomarkers for Major Adverse Cardiac Events Using SVM with PLS Feature Selection and Extraction.

Comprehensive machine learning models for prediction of heart failure in 476,393 women and men from the UK Biobank reveal sex differences and underutilized risk factors

Risk markers by sex for in-hospital mortality in patients with acute coronary syndrome: a machine learning approach

Exploration of Machine Learning for Hyperuricemia Prediction Models Based on Basic Health Checkup Tests

Machine Learning Prediction of Biomarkers from SNPs and of Disease Risk from Biomarkers in the UK Biobank

Improving Cardiovascular Risk Prediction Through Machine Learning Modelling of Irregularly Repeated Electronic Health Records

Sex-specific models to predict 5-year mortality after ST-elevation myocardial infarction using machine learning: insight from FAST-MI registry

Sex-specific proteomic signatures improve cardiovascular risk prediction for the general population without cardiovascular disease or diabetes

Stratifying risk of disease in haematuria patients using machine learning techniques to improve diagnostics

Preventive machine learning models incorporating health checkup data and hair mineral analysis for low bone mass identification

Analyzing classification and feature selection strategies for diabetes prediction across diverse diabetes datasets

Enhancing breast cancer screening with urinary biomarkers and Random Forest supervised classification: a comprehensive investigation

Discovering biomarkers associated and predicting cardiovascular disease with high accuracy using a novel nexus of machine learning techniques for precision medicine

An application of machine learning based on real-world data: Mining features of fibrinogen in clinical stages of lung cancer between sexes

Sex-Based Performance Disparities in Machine Learning Algorithms for Cardiac Disease Prediction: Exploratory Study

Risk prediction model of metabolic syndrome in perimenopausal women based on machine learning

Using Resistin, glucose, age and BMI to predict the presence of breast cancer

Integrating Health Data-Driven Machine Learning Algorithms to Evaluate Risk Factors of Early Stage Hypertension at Different Levels of HDL and LDL Cholesterol