Abstract:The influence of Large Language Models (LLMs) is rapidly growing, automating more jobs over time. Assessing the fairness of LLMs is crucial due to their expanding impact. Studies reveal the reflection of societal norms and biases in LLMs, which creates a risk of propagating societal stereotypes in downstream tasks. Many studies on bias in LLMs focus on gender bias in various NLP applications. However, there's a gap in research on bias in emotional attributes, despite the close societal link between emotion and gender. This gap is even larger for low-resource languages like Bangla. Historically, women are associated with emotions like empathy, fear, and guilt, while men are linked to anger, bravado, and authority. This pattern reflects societal norms in Bangla-speaking regions. We offer the first thorough investigation of gendered emotion attribution in Bangla for both closed and open source LLMs in this work. Our aim is to elucidate the intricate societal relationship between gender and emotion specifically within the context of Bangla. We have been successful in showing the existence of gender bias in the context of emotions in Bangla through analytical methods and also show how emotion attribution changes on the basis of gendered role selection in LLMs. All of our resources including code and data are made publicly available to support future research on Bangla NLP. Warning: This paper contains explicit stereotypical statements that many may find offensive.

What problem does this paper attempt to address?

The paper primarily explores the performance and impact of large language models (LLMs) on gender stereotypes in emotional attributes when processing Bangla. The study focuses on the following aspects: 1. **Research Background**: With the widespread application of large language models in automated tasks, evaluating the fairness of these models has become crucial. Existing research indicates that these models reflect social norms and biases, potentially propagating societal stereotypes. 2. **Research Objectives**: The paper aims to investigate the stereotypes between gender and emotional attributes in Bangla within large language models. Although previous studies have focused on gender bias in natural language processing (NLP) applications, there is limited research on gender bias in emotional attributes, especially in low-resource languages like Bangla. 3. **Research Methods**: The authors reveal potential gender stereotypes by analyzing the emotional attributions of different gender roles in given contexts using large language models. The experimental design includes: - Using two different instruction templates to pose questions to the model. - Assigning the model male or female personas and reporting emotions based on the given context. - Conducting the experiment using Zero-Shot Learning, which means no training examples are provided to avoid introducing prior biases. 4. **Research Results**: By testing three advanced multilingual large language models (including open-source and closed-source models), the study found significant gender differences in emotional attribution. For example, female roles are typically associated with emotions like sadness and shame, while male roles are more often linked to emotions like surprise and anger. 5. **Conclusion and Outlook**: This study is the first to reveal the existence of gender emotional stereotypes in large language models for Bangla. These findings raise concerns about the potential negative impacts of directly applying such models to emotion-related NLP tasks, particularly considering that they may reinforce harmful stereotypes. Future research can further explore ways to reduce or eliminate these biases, ensuring that NLP applications are more fair and accurate.

An Empirical Study of Gendered Stereotypes in Emotional Attributes for Bangla in Multilingual Large Language Models

Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Bias

An Empirical Study on the Characteristics of Bias upon Context Length Variation for Bangla

Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attribution

Gender Bias Mitigation for Bangla Classification Tasks

BanStereoSet: A Dataset to Measure Stereotypical Social Biases in LLMs for Bangla

Exploring Bengali Religious Dialect Biases in Large Language Models with Evaluation Perspectives

Emotion Analysis of Social Media Bangla Text and Its Impact on Identifying the Author's Gender

Bengali & Banglish: A monolingual dataset for emotion detection in linguistically diverse contexts

Gender bias and stereotypes in Large Language Models

Estimating Gender Based On Bengali Conventional Full Name With Various Machine Learning Techniques

A Case Study on the Independence of Speech Emotion Recognition in Bangla and English Languages using Language-Independent Prosodic Features

Investigating Subtler Biases in LLMs: Ageism, Beauty, Institutional, and Nationality Bias in Generative Models

Divine LLaMAs: Bias, Stereotypes, Stigmatization, and Emotion Representation of Religion in Large Language Models

Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts

Sentiment analysis in Bengali via transfer learning using multi-lingual BERT

The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biases

Sentiment analysis in multilingual context: Comparative analysis of machine learning and hybrid deep learning models

Evaluation of Large Language Models: STEM education and Gender Stereotypes

Interpreting Bias in Large Language Models: A Feature-Based Approach