Abstract:OBJECTIVE: The integration of artificial intelligence (AI) and machine learning (ML) in health care to aid clinical decisions is widespread. However, as AI and ML take important roles in health care, there are concerns about AI and ML associated fairness and bias. That is, an AI tool may have a disparate impact, with its benefits and drawbacks unevenly distributed across societal strata and subpopulations, potentially exacerbating existing health inequities. Thus, the objectives of this scoping review were to summarize existing literature and identify gaps in the topic of tackling algorithmic bias and optimizing fairness in AI/ML models using real-world data (RWD) in health care domains.METHODS: We conducted a thorough review of techniques for assessing and optimizing AI/ML model fairness in health care when using RWD in health care domains. The focus lies on appraising different quantification metrics for accessing fairness, publicly accessible datasets for ML fairness research, and bias mitigation approaches.RESULTS: We identified 11 papers that are focused on optimizing model fairness in health care applications. The current research on mitigating bias issues in RWD is limited, both in terms of disease variety and health care applications, as well as the accessibility of public datasets for ML fairness research. Existing studies often indicate positive outcomes when using pre-processing techniques to address algorithmic bias. There remain unresolved questions within the field that require further research, which includes pinpointing the root causes of bias in ML models, broadening fairness research in AI/ML with the use of RWD and exploring its implications in healthcare settings, and evaluating and addressing bias in multi-modal data.CONCLUSION: This paper provides useful reference material and insights to researchers regarding AI/ML fairness in real-world health care data and reveals the gaps in the field. Fair AI/ML in health care is a burgeoning field that requires a heightened research focus to cover diverse applications and different types of RWD.

A Review of Causality-Based Fairness Machine Learning

Promises and Challenges of Causality for Ethical Machine Learning

A Review on Fairness in Machine Learning

When Causality Meets Fairness: A Survey

On the Need and Applicability of Causality for Fair Machine Learning

Causality-Aided Trade-off Analysis for Machine Learning Fairness

The Flawed Foundations of Fair Machine Learning

Fairness Through Equality of Effort

Causal Discovery for Fairness

What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

Fairness issues, current approaches, and challenges in machine learning models

Causality-based Fair Multiple Decision by Response Functions

Fairness Implications of Heterogeneous Treatment Effect Estimation with Machine Learning Methods in Policy-making

Fairness-aware machine learning: a perspective

A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning

The Fragility of Fairness: Causal Sensitivity Analysis for Fair Machine Learning

Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challenges

Do the Machine Learning Models on a Crowd Sourced Platform Exhibit Bias? An Empirical Study on Model Fairness

Mind the Gap: A Causal Perspective on Bias Amplification in Prediction & Decision-Making

A scoping review of fair machine learning techniques when using real-world data