Abstract:Large language models (LLMs) have exhibited remarkable capabilities in natural language generation, but they have also been observed to magnify societal biases, particularly those related to gender. In response to this issue, several benchmarks have been proposed to assess gender bias in LLMs. However, these benchmarks often lack practical flexibility or inadvertently introduce biases. To address these shortcomings, we introduce GenderCARE, a comprehensive framework that encompasses innovative Criteria, bias Assessment, Reduction techniques, and Evaluation metrics for quantifying and mitigating gender bias in LLMs. To begin, we establish pioneering criteria for gender equality benchmarks, spanning dimensions such as inclusivity, diversity, explainability, objectivity, robustness, and realisticity. Guided by these criteria, we construct GenderPair, a novel pair-based benchmark designed to assess gender bias in LLMs comprehensively. Our benchmark provides standardized and realistic evaluations, including previously overlooked gender groups such as transgender and non-binary individuals. Furthermore, we develop effective debiasing techniques that incorporate counterfactual data augmentation and specialized fine-tuning strategies to reduce gender bias in LLMs without compromising their overall performance. Extensive experiments demonstrate a significant reduction in various gender bias benchmarks, with reductions peaking at over 90% and averaging above 35% across 17 different LLMs. Importantly, these reductions come with minimal variability in mainstream language tasks, remaining below 2%. By offering a realistic assessment and tailored reduction of gender biases, we hope that our GenderCARE can represent a significant step towards achieving fairness and equity in LLMs. More details are available at <a class="link-external link-https" href="https://github.com/kstanghere/GenderCARE-ccs24" rel="external noopener nofollow">this https URL</a>.

CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation

GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Models

Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints

Gender Bias in Large Language Models across Multiple Languages

Mitigating Gender Bias in Natural Language Processing: Literature Review

Locating and Mitigating Gender Bias in Large Language Models

Exploration, detection, and mitigation: Unveiling gender bias in NLP

Mitigating Gender Bias in Captioning Systems

Learning from Red Teaming: Gender Bias Provocation and Mitigation in Large Language Models

Mitigating Gender Bias in Code Large Language Models via Model Editing

Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods

Toward Understanding Bias Correlations for Mitigation in NLP

Probing Explicit and Implicit Gender Bias through LLM Conditional Text Generation

On Measuring Gender Bias in Translation of Gender-neutral Pronouns

Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias

CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models

The Moral Foundations Weibo Corpus

Bias Beyond English: Counterfactual Tests for Bias in Sentiment Analysis in Four Languages

Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correction

Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples