Abstract:Large language models (LLMs) have shown impressive potential in helping with numerous medical challenges. Deploying LLMs in high-stakes applications such as medicine, however, brings in many concerns. One major area of concern relates to biased behaviors of LLMs in medical applications, leading to unfair treatment of individuals. To pave the way for the responsible and impactful deployment of Med LLMs, rigorous evaluation is a key prerequisite. Due to the huge complexity and variability of different medical scenarios, existing work in this domain has primarily relied on using manually crafted datasets for bias evaluation. In this study, we present a new method to scale up such bias evaluations by automatically generating test cases based on rigorous medical evidence. We specifically target the challenges of a) domain-specificity of bias characterization, b) hallucinating while generating the test cases, and c) various dependencies between the health outcomes and sensitive attributes. To that end, we offer new methods to address these challenges integrated with our generative pipeline, using medical knowledge graphs, medical ontologies, and customized general LLM evaluation frameworks in our method. Through a series of extensive experiments, we show that the test cases generated by our proposed method can effectively reveal bias patterns in Med LLMs at larger and more flexible scales than human-crafted datasets. We publish a large bias evaluation dataset using our pipeline, which is dedicated to a few medical case studies. A live demo of our application for vignette generation is available at <a class="link-external link-https" href="https://vignette.streamlit.app" rel="external noopener nofollow">this https URL</a>. Our code is also available at <a class="link-external link-https" href="https://github.com/healthylaife/autofair" rel="external noopener nofollow">this https URL</a>.

DiversityMedQA: Assessing Demographic Biases in Medical Diagnosis using Large Language Models

Evaluation and mitigation of cognitive biases in medical language models

Evaluating and Addressing Demographic Disparities in Medical Large Language Models: A Systematic Review

Addressing cognitive bias in medical language models

A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Models

How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?

Bias patterns in the application of LLMs for clinical decision support: A comprehensive study

Unveiling Performance Challenges of Large Language Models in Low-Resource Healthcare: A Demographic Fairness Perspective

Evaluating Anti-LGBTQIA+ Medical Bias in Large Language Models

FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Tasks

Evaluation of Bias Towards Medical Professionals in Large Language Models

Quantifying Bias in Agentic Large Language Models: A Benchmarking Approach

Detecting Bias and Enhancing Diagnostic Accuracy in Large Language Models for Healthcare

Mitigating the Risk of Health Inequity Exacerbated by Large Language Models

Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias

Enabling Scalable Evaluation of Bias Patterns in Medical LLMs

Towards Accurate Differential Diagnosis with Large Language Models

Large Language Model Benchmarks in Medical Tasks

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Large Language Models in Healthcare: A Comprehensive Benchmark