Abstract:Summary Background It has been shown that AI models can learn race on medical images, leading to algorithmic bias. Our aim in this study was to enhance the fairness of medical image models by eliminating bias related to race, age, and sex. We hypothesise models may be learning demographics via shortcut learning and combat this using image augmentation. Methods This study included 44,953 patients who identified as Asian, Black, or White (mean age, 60.68 years ±18.21; 23,499 women) for a total of 194,359 chest X-rays (CXRs) from MIMIC-CXR database. The included CheXpert images comprised 45,095 patients (mean age 63.10 years ±18.14; 20,437 women) for a total of 134,300 CXRs were used for external validation. We also collected 1195 3D brain magnetic resonance imaging (MRI) data from the ADNI database, which included 273 participants with an average age of 76.97 years ±14.22, and 142 females. DL models were trained on either non-augmented or augmented images and assessed using disparity metrics. The features learned by the models were analysed using task transfer experiments and model visualisation techniques. Findings In the detection of radiological findings, training a model using augmented CXR images was shown to reduce disparities in error rate among racial groups (−5.45%), age groups (−13.94%), and sex (−22.22%). For AD detection, the model trained with augmented MRI images was shown 53.11% and 31.01% reduction of disparities in error rate among age and sex groups, respectively. Image augmentation led to a reduction in the model's ability to identify demographic attributes and resulted in the model trained for clinical purposes incorporating fewer demographic features. Interpretation The model trained using the augmented images was less likely to be influenced by demographic information in detecting image labels. These results demonstrate that the proposed augmentation scheme could enhance the fairness of interpretations by DL models when dealing with data from patients with different demographic backgrounds. Funding National Science and Technology Council (Taiwan), National Institutes of Health .

Discovering mechanisms underlying medical AI prediction of protected attributes

Algorithmic encoding of protected characteristics in image-based models for disease detection

The Limits of Fair Medical Imaging AI In The Wild

Deep Learning Discovery of Demographic Biomarkers in Echocardiography

Drop the shortcuts: image augmentation improves fairness and decreases AI detection of race and other demographics from medical images

Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations

Acquisition parameters influence AI recognition of race in chest x-rays and mitigating these factors reduces underdiagnosis bias

Risk of Training Diagnostic Algorithms on Data with Demographic Bias

Achieve Fairness without Demographics for Dermatological Disease Diagnosis

Explainable AI for Medical Data: Current Methods, Limitations, and Future Directions

Explainable Artificial Intelligence (XAI) for Deep Learning Based Medical Imaging Classification

Analysis of Explainable Artificial Intelligence Methods on Medical Image Classification

Reinvestigating the Performance of Artificial Intelligence Classification Algorithms on COVID-19 X-Ray and CT Images

Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks

Investigation of Demographic Implicit Discrimination and Disparate Impact in Chest Radiography Image-Based AI for COVID-19 Severity Prediction.

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Explainable Artificial Intelligence for Predictive Modeling in Healthcare

Breast Cancer Diagnosis: A Comprehensive Exploration of Explainable Artificial Intelligence (XAI) Techniques

Explainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicine

Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis

Dissection of medical AI reasoning processes via physician and generative-AI collaboration