Abstract:OBJECTIVE: The integration of artificial intelligence (AI) and machine learning (ML) in health care to aid clinical decisions is widespread. However, as AI and ML take important roles in health care, there are concerns about AI and ML associated fairness and bias. That is, an AI tool may have a disparate impact, with its benefits and drawbacks unevenly distributed across societal strata and subpopulations, potentially exacerbating existing health inequities. Thus, the objectives of this scoping review were to summarize existing literature and identify gaps in the topic of tackling algorithmic bias and optimizing fairness in AI/ML models using real-world data (RWD) in health care domains.METHODS: We conducted a thorough review of techniques for assessing and optimizing AI/ML model fairness in health care when using RWD in health care domains. The focus lies on appraising different quantification metrics for accessing fairness, publicly accessible datasets for ML fairness research, and bias mitigation approaches.RESULTS: We identified 11 papers that are focused on optimizing model fairness in health care applications. The current research on mitigating bias issues in RWD is limited, both in terms of disease variety and health care applications, as well as the accessibility of public datasets for ML fairness research. Existing studies often indicate positive outcomes when using pre-processing techniques to address algorithmic bias. There remain unresolved questions within the field that require further research, which includes pinpointing the root causes of bias in ML models, broadening fairness research in AI/ML with the use of RWD and exploring its implications in healthcare settings, and evaluating and addressing bias in multi-modal data.CONCLUSION: This paper provides useful reference material and insights to researchers regarding AI/ML fairness in real-world health care data and reveals the gaps in the field. Fair AI/ML in health care is a burgeoning field that requires a heightened research focus to cover diverse applications and different types of RWD.

Machine learning and algorithmic fairness in public and population health

Machine Learning in Population and Public Health

Connecting Fairness in Machine Learning with Public Health Equity

Algorithmic fairness in artificial intelligence for medicine and healthcare

What is Fair? Defining Fairness in Machine Learning for Health

Fairness in Machine Learning Meets with Equity in Healthcare

Algorithm Fairness in AI for Medicine and Healthcare

Exploring Bias and Prediction Metrics to Characterise the Fairness of Machine Learning for Equity-Centered Public Health Decision-Making: A Narrative Review

Algorithmic fairness in computational medicine

Assessing Fairness in Classification Parity of Machine Learning Models in Healthcare

A scoping review of fair machine learning techniques when using real-world data

Fairness-aware machine learning: a perspective

A Comparative Study of Fairness in Medical Machine Learning.

An Empirical Characterization of Fair Machine Learning For Clinical Risk Prediction

Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data

A Survey on Optimization and Machine Learning-Based Fair Decision Making in Healthcare

Evaluating Fair Feature Selection in Machine Learning for Healthcare

Multi-disciplinary fairness considerations in machine learning for clinical trials

Ethical Machine Learning in Health Care

Fair Machine Learning for Healthcare Requires Recognizing the Intersectionality of Sociodemographic Factors, a Case Study

Optimisation Strategies for Ensuring Fairness in Machine Learning: With and Without Demographics