Abstract:In efforts to keep up with the rapid progress and use of large language models, gender bias research is becoming more prevalent in NLP. Non-English bias research, however, is still in its infancy with most work focusing on English. In our work, we study how grammatical gender bias relating to politeness levels manifests in Japanese and Korean language models. Linguistic studies in these languages have identified a connection between gender bias and politeness levels, however it is not yet known if language models reproduce these biases. We analyze relative prediction probabilities of the male and female grammatical genders using templates and find that informal polite speech is most indicative of the female grammatical gender, while rude and formal speech is most indicative of the male grammatical gender. Further, we find politeness levels to be an attack vector for allocational gender bias in cyberbullying detection models. Cyberbullies can evade detection through simple techniques abusing politeness levels. We introduce an attack dataset to (i) identify representational gender bias across politeness levels, (ii) demonstrate how gender biases can be abused to bypass cyberbullying detection models and (iii) show that allocational biases can be mitigated via training on our proposed dataset. Through our findings we highlight the importance of bias research moving beyond its current English-centrism.

TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languages

A Computational Approach to Politeness with Application to Social Factors

Translating Politeness Across Cultures: Case of Hindi and English

Computational Politeness in Natural Language Processing: A Survey

Studying Politeness across Cultures using English Twitter and Mandarin Weibo

Comparing Styles across Languages

Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite

Politeness Stereotypes and Attack Vectors: Gender Stereotypes in Japanese and Korean Language Models

Towards a Sociolinguistics-Based Framework for the Study of Politeness in Human-Computer Interaction

Towards automatic identification of linguistic politeness in Hindi texts

TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

TYPES OF POLITENESS IN ENGLISH: LINGUISTIC ASPECTS AND PEDAGOGICAL IMPLICATIONS

D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation

Exploring Brown and Levinson's Politeness Strategies: An Explanation on the Nature of the Politeness Phenomenon

NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violation

PIPPA: A Partially Synthetic Conversational Dataset

DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning

Modeling Global Syntactic Variation in English Using Dialect Classification

Politeness theory and computer-mediated communication: a sociolinguistic approach to analyzing relational messages

Politeness: some universals in language usage