Abstract:Gender bias represents a form of systematic negative treatment that targets individuals based on their gender. This discrimination can range from subtle sexist remarks and gendered stereotypes to outright hate speech. Prior research has revealed that ignoring online abuse not only affects the individuals targeted but also has broader societal implications. These consequences extend to the discouragement of women's engagement and visibility within public spheres, thereby reinforcing gender inequality. This thesis investigates the nuances of how gender bias is expressed through language and within language technologies. Significantly, this thesis expands research on gender bias to multilingual contexts, emphasising the importance of a multilingual and multicultural perspective in understanding societal biases. In this thesis, I adopt an interdisciplinary approach, bridging natural language processing with other disciplines such as political science and history, to probe gender bias in natural language and language models.

What problem does this paper attempt to address?

The paper primarily explores the manifestation and measurement methods of gender bias in natural language and language technologies, emphasizing the importance of studying gender bias in a multilingual context. The author, Karolina Stańczak, through her doctoral dissertation, investigates how gender bias is expressed through language and reflected in language technologies, with a particular focus on multilingual and multicultural perspectives. Key contributions of the paper include: 1. **Extending the study of gender bias to multilingual environments**: The paper broadens the scope of gender bias research beyond English to include multiple language environments. This helps in better understanding social biases across different cultural backgrounds. 2. **Constructing datasets for analysis**: The author created datasets from various domains (such as social media data, historical newspapers, etc.) to analyze gender bias. 3. **Introducing new bias measurement methods**: The paper introduces intersectional gender bias measurement methods and conducts causal research on how the grammatical gender of nouns affects people's perceptions of those nouns. 4. **Developing new methods for probing language models**: The author proposes some novel methods to probe language models for linguistic information and social biases. Specifically, in the field of natural language processing, the main contributions of the paper are as follows: - Creating datasets based on different domains, such as social media data and historical newspapers, to analyze gender bias. - Proposing intersectional gender bias measurement methods and conducting a causal study on the impact of noun grammatical gender on people's cognition. - In terms of language model probing methods, proposing two different dataset creation methods: one using simple template structures to generate words directly adjacent to entity names to measure the association between language models and these entities; the other collecting a series of stereotypes and identities belonging to different social categories to form a probing dataset, analyzing the association between language models and social groups and their internal identities. In summary, this paper makes significant contributions to understanding the forms and extent of gender bias in natural language and language models and promotes the development of research methods in this field.

A Multilingual Perspective on Probing Gender Bias

A Survey on Gender Bias in Natural Language Processing

Exploration, detection, and mitigation: Unveiling gender bias in NLP

Gender Bias and Sexism in Language

Measuring Gender Bias in West Slavic Language Models

Theories of "Gender" in NLP Bias Research

Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias

Toward Gender-Inclusive Coreference Resolution: An Analysis of Gender and Bias Throughout the Machine Learning Lifecycle

Mitigating Gender Bias in Natural Language Processing: Literature Review

The Birth of Bias: A case study on the evolution of gender bias in an English language model

A World Full of Stereotypes? Further Investigation on Origin and Gender Bias in Multi-Lingual Word Embeddings

Quantifying gender bias towards politicians in cross-lingual language models

Gender Bias in Large Language Models across Multiple Languages

Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation

Public Perceptions of Gender Bias in Large Language Models: Cases of ChatGPT and Ernie

Examining Gender Bias in Languages with Grammatical Gender

Exploring Gender Biases in Language Patterns of Human-Conversational Agent Conversations

Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias

Politeness Stereotypes and Attack Vectors: Gender Stereotypes in Japanese and Korean Language Models

Investigating Markers and Drivers of Gender Bias in Machine Translations