Abstract:Artificial intelligence (AI) models trained using medical images for clinical tasks often exhibit bias in the form of disparities in performance between subgroups. Since not all sources of biases in real-world medical imaging data are easily identifiable, it is challenging to comprehensively assess how those biases are encoded in models, and how capable bias mitigation methods are at ameliorating performance disparities. In this article, we introduce a novel analysis framework for systematically and objectively investigating the impact of biases in medical images on AI models. We developed and tested this framework for conducting controlled in silico trials to assess bias in medical imaging AI using a tool for generating synthetic magnetic resonance images with known disease effects and sources of bias. The feasibility is showcased by using three counterfactual bias scenarios to measure the impact of simulated bias effects on a convolutional neural network (CNN) classifier and the efficacy of three bias mitigation strategies. The analysis revealed that the simulated biases resulted in expected subgroup performance disparities when the CNN was trained on the synthetic datasets. Moreover, reweighing was identified as the most successful bias mitigation strategy for this setup, and we demonstrated how explainable AI methods can aid in investigating the manifestation of bias in the model using this framework. Developing fair AI models is a considerable challenge given that many and often unknown sources of biases can be present in medical imaging datasets. In this work, we present a novel methodology to objectively study the impact of biases and mitigation strategies on deep learning pipelines, which can support the development of clinical AI that is robust and responsible.

Addressing fairness in artificial intelligence for medical imaging

Open Challenges on Fairness of Artificial Intelligence in Medical Imaging Applications

Addressing Fairness Issues in Deep Learning-Based Medical Image Analysis: A Systematic Review

Towards unraveling calibration biases in medical image analysis

Toward fairness in artificial intelligence for medical image analysis: identification and mitigation of potential biases in the roadmap from data collection to model deployment

Algorithm Fairness in AI for Medicine and Healthcare

Algorithmic fairness in artificial intelligence for medicine and healthcare

Fairness in AI for healthcare

Fairness via AI: Bias Reduction in Medical Information

Navigating Fairness in Radiology AI: Concepts, Consequences,and Crucial Considerations

Bias in artificial intelligence for medical imaging: fundamentals, detection, avoidance, mitigation, challenges, ethics, and prospects

The Limits of Fair Medical Imaging AI In The Wild

Fairness of artificial intelligence in healthcare: review and recommendations

Addressing Algorithmic Bias and the Perpetuation of Health Inequities: An AI Bias Aware Framework

Addressing Bias in Artificial Intelligence in Health Care

A scientometric analysis of fairness in health AI literature

Fairness in Medical Image Analysis and Healthcare: A Literature Survey

Addressing bias in big data and AI for health care: A call for open science

Towards objective and systematic evaluation of bias in artificial intelligence for medical imaging

Towards Clinical AI Fairness: Filling Gaps in the Puzzle