Abstract:Large language models (LLMs) have exhibited remarkable capabilities in natural language generation, but they have also been observed to magnify societal biases, particularly those related to gender. In response to this issue, several benchmarks have been proposed to assess gender bias in LLMs. However, these benchmarks often lack practical flexibility or inadvertently introduce biases. To address these shortcomings, we introduce GenderCARE, a comprehensive framework that encompasses innovative Criteria, bias Assessment, Reduction techniques, and Evaluation metrics for quantifying and mitigating gender bias in LLMs. To begin, we establish pioneering criteria for gender equality benchmarks, spanning dimensions such as inclusivity, diversity, explainability, objectivity, robustness, and realisticity. Guided by these criteria, we construct GenderPair, a novel pair-based benchmark designed to assess gender bias in LLMs comprehensively. Our benchmark provides standardized and realistic evaluations, including previously overlooked gender groups such as transgender and non-binary individuals. Furthermore, we develop effective debiasing techniques that incorporate counterfactual data augmentation and specialized fine-tuning strategies to reduce gender bias in LLMs without compromising their overall performance. Extensive experiments demonstrate a significant reduction in various gender bias benchmarks, with reductions peaking at over 90% and averaging above 35% across 17 different LLMs. Importantly, these reductions come with minimal variability in mainstream language tasks, remaining below 2%. By offering a realistic assessment and tailored reduction of gender biases, we hope that our GenderCARE can represent a significant step towards achieving fairness and equity in LLMs. More details are available at <a class="link-external link-https" href="https://github.com/kstanghere/GenderCARE-ccs24" rel="external noopener nofollow">this https URL</a>.

Mixup-based Unified Framework to Overcome Gender Bias Resurgence

Gender-tuning: Empowering Fine-tuning for Debiasing Pre-trained Language Models

Editable Fairness: Fine-Grained Bias Mitigation in Language Models

Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness

ProxiMix: Enhancing Fairness with Proximity Samples in Subgroups

Locating and Mitigating Gender Bias in Large Language Models

Harnessing Hard Mixed Samples with Decoupled Regularizer

Mitigating Social Biases of Pre-trained Language Models via Contrastive Self-Debiasing with Double Data Augmentation

Does Debiasing Inevitably Degrade the Model Performance

Prompt Tuning Pushes Farther, Contrastive Learning Pulls Closer: A Two-Stage Approach to Mitigate Social Biases

Mitigating Gender Bias in Contextual Word Embeddings

GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Models

GBMix: Enhancing Fairness by Group-Balanced Mixup

Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventions

Bias Mitigation in Fine-tuning Pre-trained Models for Enhanced Fairness and Efficiency

MoESD: Mixture of Experts Stable Diffusion to Mitigate Gender Bias

Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning

General Phrase Debiaser: Debiasing Masked Language Models at a Multi-Token Level

REFINE-LM: Mitigating Language Model Stereotypes via Reinforcement Learning

Controlling Bias Exposure for Fair Interpretable Predictions