Abstract:Large language models (LLMs) have exhibited remarkable capabilities in natural language generation, but they have also been observed to magnify societal biases, particularly those related to gender. In response to this issue, several benchmarks have been proposed to assess gender bias in LLMs. However, these benchmarks often lack practical flexibility or inadvertently introduce biases. To address these shortcomings, we introduce GenderCARE, a comprehensive framework that encompasses innovative Criteria, bias Assessment, Reduction techniques, and Evaluation metrics for quantifying and mitigating gender bias in LLMs. To begin, we establish pioneering criteria for gender equality benchmarks, spanning dimensions such as inclusivity, diversity, explainability, objectivity, robustness, and realisticity. Guided by these criteria, we construct GenderPair, a novel pair-based benchmark designed to assess gender bias in LLMs comprehensively. Our benchmark provides standardized and realistic evaluations, including previously overlooked gender groups such as transgender and non-binary individuals. Furthermore, we develop effective debiasing techniques that incorporate counterfactual data augmentation and specialized fine-tuning strategies to reduce gender bias in LLMs without compromising their overall performance. Extensive experiments demonstrate a significant reduction in various gender bias benchmarks, with reductions peaking at over 90% and averaging above 35% across 17 different LLMs. Importantly, these reductions come with minimal variability in mainstream language tasks, remaining below 2%. By offering a realistic assessment and tailored reduction of gender biases, we hope that our GenderCARE can represent a significant step towards achieving fairness and equity in LLMs. More details are available at <a class="link-external link-https" href="https://github.com/kstanghere/GenderCARE-ccs24" rel="external noopener nofollow">this https URL</a>.

Behavior Theory Enabled Gender Classification Method - (Research in Progress).

Gender Classification of Product Reviewers in China: a Data-Driven Approach

Human Gender Classification: A Review

Gender Differences in the Effect of Communication on College Students' Online Decisions

User Gender Classification in Chinese Microblog

Gender Classification of Chinese Weibo Users

Discriminating gender on Chinese microblog: A study of online behaviour, writing style and preferred vocabulary

Multi-Dimensional Gender Bias Classification

What's in a Name? -- Gender Classification of Names with Character Based Machine Learning Models

Exploration, detection, and mitigation: Unveiling gender bias in NLP

Gender Classification by Combining Clothing, Hair and Facial Component Classifiers

Automatically Inferring Gender Associations from Language

Gender Identification on Social Media

Characterizing gender stereotypes in popular fiction: A machine learning approach

Gender Classification System in Uncontrolled Environments

GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Models

Soft Biometrics in Online Social Networks: A Case Study on Twitter User Gender Recognition

Analysis of Gender Bias in Social Perception and Judgement Using Chinese Word Embeddings

Unveiling Gender Bias in Large Language Models: Using Teacher's Evaluation in Higher Education As an Example

Detecting Gender Bias in Transformer-based Models: A Case Study on BERT

An Open-Source Cultural Consensus Approach to Name-Based Gender Classification