Abstract:Large Language Models(LLMs) have revolutionized various applications in natural language processing (NLP) by providing unprecedented text generation, translation, and comprehension capabilities. However, their widespread deployment has brought to light significant concerns regarding biases embedded within these models. This paper presents a comprehensive survey of biases in LLMs, aiming to provide an extensive review of the types, sources, impacts, and mitigation strategies related to these biases. We systematically categorize biases into several dimensions. Our survey synthesizes current research findings and discusses the implications of biases in real-world applications. Additionally, we critically assess existing bias mitigation techniques and propose future research directions to enhance fairness and equity in LLMs. This survey serves as a foundational resource for researchers, practitioners, and policymakers concerned with addressing and understanding biases in LLMs.

What problem does this paper attempt to address?

The paper attempts to address the issue of bias in large language models (LLMs). Specifically, it aims to comprehensively review and analyze various types, sources, impacts, and mitigation strategies of biases in LLMs. The main focus points of the paper are as follows: 1. **Types of Bias**: - The paper systematically categorizes biases into multiple dimensions, including demographic biases (such as gender, race, age), contextual biases, algorithmic biases, etc. 2. **Sources of Bias**: - The paper explores various sources of bias, including biases in training data, biases in model design and architecture, biases in the human annotation process, feedback loop biases in user interactions, and the influence of socio-cultural backgrounds. 3. **Impact of Bias**: - The paper evaluates the impact of these biases on practical applications and social ethics, discussing how biases can lead to unfair or discriminatory outcomes in the real world, particularly in fields such as healthcare, finance, and education. 4. **Bias Detection and Mitigation**: - The paper reviews existing methods for bias detection and mitigation and proposes future research directions to improve the fairness and justice of LLMs. 5. **Future Research Directions**: - The paper points out the current research deficiencies, such as the lack of standardized and cross-bias evaluation metrics, and suggests that future research should develop unified, multi-dimensional bias evaluation methods to better understand and address the bias issues in LLMs. In summary, through a comprehensive survey and analysis, the paper aims to provide researchers, practitioners, and policymakers with a foundational resource on the issue of bias in LLMs, helping them better understand and tackle this challenge.

A Comprehensive Survey of Bias in LLMs: Current Landscape and Future Directions

Bias and Fairness in Large Language Models: A Survey

A Survey on Fairness in Large Language Models

Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perception

People's Perceptions Toward Bias and Related Concepts in Large Language Models: A Systematic Review

Fairness in Large Language Models: A Taxonomic Survey

The Life Cycle of Large Language Models: A Review of Biases in Education

Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMs

With a Grain of SALT: Are LLMs Fair Across Social Dimensions?

Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies

Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models

LLMs are Biased Teachers: Evaluating LLM Bias in Personalized Education

A Comprehensive Evaluation of Cognitive Biases in LLMs

Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era

The African Woman is Rhythmic and Soulful: An Investigation of Implicit Biases in LLM Open-ended Text Generation

A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias

Gender bias and stereotypes in Large Language Models

Capturing Bias Diversity in LLMs

Sociodemographic Bias in Language Models: A Survey and Forward Path