Abstract:Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs become increasingly proprietary, it may not be possible to access their embeddings and apply existing bias measures; furthermore, implicit biases are primarily a concern if they affect the actual decisions that these systems make. We address both challenges by introducing two new measures of bias: LLM Implicit Bias, a prompt-based method for revealing implicit bias; and LLM Decision Bias, a strategy to detect subtle discrimination in decision-making tasks. Both measures are based on psychological research: LLM Implicit Bias adapts the Implicit Association Test, widely used to study the automatic associations between concepts held in human minds; and LLM Decision Bias operationalizes psychological results indicating that relative evaluations between two candidates, not absolute evaluations assessing each independently, are more diagnostic of implicit biases. Using these measures, we found pervasive stereotype biases mirroring those in society in 8 value-aligned models across 4 social categories (race, gender, religion, health) in 21 stereotypes (such as race and criminality, race and weapons, gender and science, age and negativity). Our prompt-based LLM Implicit Bias measure correlates with existing language model embedding-based bias methods, but better predicts downstream behaviors measured by LLM Decision Bias. These new prompt-based measures draw from psychology's long history of research into measuring stereotype biases based on purely observable behavior; they expose nuanced biases in proprietary value-aligned LLMs that appear unbiased according to standard benchmarks.

Reducing Large Language Model Bias with Emphasis on 'Restricted Industries': Automated Dataset Augmentation and Prejudice Quantification

Mitigating Large Language Model Bias: Automated Dataset Augmentation and Prejudice Quantification

A Trip Towards Fairness: Bias and De-Biasing in Large Language Models

Do the Right Thing, Just Debias! Multi-Category Bias Mitigation Using LLMs

Evaluating and Mitigating Social Bias for Large Language Models in Open-ended Settings

Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMs

Quantifying Bias in Agentic Large Language Models: A Benchmarking Approach

Bias and Fairness in Large Language Models: A Survey

Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory

Understanding Intrinsic Socioeconomic Biases in Large Language Models

Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models

Reducing Selection Bias in Large Language Models

Social Debiasing for Fair Multi-modal LLMs

Breaking Bias, Building Bridges: Evaluation and Mitigation of Social Biases in LLMs via Contact Hypothesis

Cognitive bias in large language models: Cautious optimism meets anti-Panglossian meliorism

Towards Resource Efficient and Interpretable Bias Mitigation in Large Language Models

Measuring Implicit Bias in Explicitly Unbiased Large Language Models

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Unboxing Occupational Bias: Grounded Debiasing of LLMs with U.S. Labor Data

An Actionable Framework for Assessing Bias and Fairness in Large Language Model Use Cases