Abstract:Large language models (LLMs) have exhibited remarkable capabilities in natural language generation, but they have also been observed to magnify societal biases, particularly those related to gender. In response to this issue, several benchmarks have been proposed to assess gender bias in LLMs. However, these benchmarks often lack practical flexibility or inadvertently introduce biases. To address these shortcomings, we introduce GenderCARE, a comprehensive framework that encompasses innovative Criteria, bias Assessment, Reduction techniques, and Evaluation metrics for quantifying and mitigating gender bias in LLMs. To begin, we establish pioneering criteria for gender equality benchmarks, spanning dimensions such as inclusivity, diversity, explainability, objectivity, robustness, and realisticity. Guided by these criteria, we construct GenderPair, a novel pair-based benchmark designed to assess gender bias in LLMs comprehensively. Our benchmark provides standardized and realistic evaluations, including previously overlooked gender groups such as transgender and non-binary individuals. Furthermore, we develop effective debiasing techniques that incorporate counterfactual data augmentation and specialized fine-tuning strategies to reduce gender bias in LLMs without compromising their overall performance. Extensive experiments demonstrate a significant reduction in various gender bias benchmarks, with reductions peaking at over 90% and averaging above 35% across 17 different LLMs. Importantly, these reductions come with minimal variability in mainstream language tasks, remaining below 2%. By offering a realistic assessment and tailored reduction of gender biases, we hope that our GenderCARE can represent a significant step towards achieving fairness and equity in LLMs. More details are available at <a class="link-external link-https" href="https://github.com/kstanghere/GenderCARE-ccs24" rel="external noopener nofollow">this https URL</a>.

Second Order WinoBias (SoWinoBias) Test Set for Latent Gender Bias Detection in Coreference Resolution

Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods

WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case

Gender Bias in Coreference Resolution

WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models

Gender Bias in Contextualized Word Embeddings

Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models

Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias

Toward Gender-Inclusive Coreference Resolution: An Analysis of Gender and Bias Throughout the Machine Learning Lifecycle

Gender Bias in Text: Labeled Datasets and Lexicons

Gender Bias in Neural Natural Language Processing

Robustness and Reliability of Gender Bias Assessment in Word Embeddings: The Role of Base Pairs

Projective Methods for Mitigating Gender Bias in Pre-trained Language Models

Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem

Data Bias According to Bipol: Men are Naturally Right and It is the Role of Women to Follow Their Lead

GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Models

How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification

Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting

The Birth of Bias: A case study on the evolution of gender bias in an English language model

Evaluating Gender Bias in Natural Language Inference

How Gender Debiasing Affects Internal Model Representations, and Why It Matters