Towards Bridging the Digital Language Divide

Gábor Bella,Paula Helm,Gertraud Koch,Fausto Giunchiglia

2023-07-25

Abstract:It is a well-known fact that current AI-based language technology -- language models, machine translation systems, multilingual dictionaries and corpora -- focuses on the world's 2-3% most widely spoken languages. Recent research efforts have attempted to expand the coverage of AI technology to `under-resourced languages.' The goal of our paper is to bring attention to a phenomenon that we call linguistic bias: multilingual language processing systems often exhibit a hardwired, yet usually involuntary and hidden representational preference towards certain languages. Linguistic bias is manifested in uneven per-language performance even in the case of similar test conditions. We show that biased technology is often the result of research and development methodologies that do not do justice to the complexity of the languages being represented, and that can even become ethically problematic as they disregard valuable aspects of diversity as well as the needs of the language communities themselves. As our attempt at building diversity-aware language resources, we present a new initiative that aims at reducing linguistic bias through both technological design and methodology, based on an eye-level collaboration with local communities.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the Digital Language Divide, that is, most languages in the world are under - represented in the Internet and global digital infrastructure. Specifically, current AI - based language technologies - such as language models, machine translation systems, multilingual dictionaries and corpora - mainly focus on 2 - 3% of the most widely used languages in the world. This linguistic bias in technology leads to an unbalanced performance of multilingual processing systems among different languages, even under similar test conditions. The paper points out that this bias is usually due to research and development methods that fail to fully consider the complexity of the represented languages, and may even overlook the diversity of language communities and their needs, thus becoming an ethical issue. In order to reduce linguistic bias, the author proposes a new initiative, starting from both technical and methodological aspects through cooperation with local communities, aiming to establish language resources that are sensitive to diversity, so as to systematically reduce linguistic bias. Therefore, the core issue of the paper is to reduce the linguistic bias in language technologies through technological innovation and methodological improvement, as well as cooperation with local communities, and then narrow the Digital Language Divide.

Towards Bridging the Digital Language Divide

Tackling Language Modelling Bias in Support of Linguistic Diversity

Diversity and Language Technology: How Techno-Linguistic Bias Can Cause Epistemic Injustice

Diversity and Language Technology: How Language Modeling Bias Causes Epistemic Injustice

A Trip Towards Fairness: Bias and De-Biasing in Large Language Models

Gender Bias in Online Language Translators: Visualization, Human Perception, and Bias/Accuracy Tradeoffs

Artificial Intelligence in mental health and the biases of language based models

A global AI community requires language-diverse publishing

Fairness in Language Models Beyond English: Gaps and Challenges

Comparing Biases and the Impact of Multilingual Training across Multiple Languages

The BIAS Detection Framework: Bias Detection in Word Embeddings and Language Models for European Languages

Layers of technology in pluriversal design. Decolonising language technology with the LiveLanguage initiative

Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies

The Call for Socially Aware Language Technologies

Global Voices, Local Biases: Socio-Cultural Prejudices across Languages

Systematic Inequalities in Language Technology Performance across the World's Languages

From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models

Gender Bias and Under-Representation in Natural Language Processing Across Human Languages

Investigating Markers and Drivers of Gender Bias in Machine Translations

Unraveling Downstream Gender Bias from Large Language Models: A Study on AI Educational Writing Assistance

Are AI systems biased against the poor? A machine learning analysis using Word2Vec and GloVe embeddings