Rada Mihalcea,Oana Ignat,Longju Bai,Angana Borah,Luis Chiruzzo,Zhijing Jin,Claude Kwizera,Joan Nwatu,Soujanya Poria,Thamar Solorio
Abstract:This paper presents a vision for creating AI systems that are inclusive at every stage of development, from data collection to model design and evaluation. We address key limitations in the current AI pipeline and its WEIRD representation, such as lack of data diversity, biases in model performance, and narrow evaluation metrics. We also focus on the need for diverse representation among the developers of these systems, as well as incentives that are not skewed toward certain groups. We highlight opportunities to develop AI systems that are for everyone (with diverse stakeholders in mind), with everyone (inclusive of diverse data and annotators), and by everyone (designed and developed by a globally diverse workforce).
What problem does this paper attempt to address?
### What problems does this paper attempt to solve?
This paper aims to solve the problem of **insufficient inclusiveness** in the current development, design, and evaluation processes of artificial intelligence (AI) systems. Specifically, the authors focus on the following key aspects:
1. **Lack of data diversity**:
- Current AI models mainly rely on a large amount of text and image data crawled from the Internet. These data are mainly from Western countries, ignoring the data of many other cultural and social groups in the world. This leads to the model's limited ability to understand different cultures and languages.
- There is a lack of transparency in the data collection and annotation processes, causing the data of certain groups to be ignored or misrepresented.
2. **Model performance deviation**:
- AI models perform inconsistently when dealing with data from different cultural backgrounds. Especially when dealing with non - English or Western - culture data, the model performance drops significantly. For example, some AI tools may misunderstand the context or give wrong results when dealing with specific dialects or languages.
- There are also differences in the performance of models in different geographical regions and income levels, resulting in unfairness in technology applications.
3. **Single evaluation standard**:
- Most of the current evaluation metrics and benchmark tests are based on Western culture and English data, unable to fully reflect the global diverse reality. For example, some reading comprehension evaluations may assume that users are familiar with Western literary references, ignoring knowledge from other cultural backgrounds.
- The lack of evaluation benchmarks that can truly reflect multiculturalism and multilingualism leads to inaccurate and unfair performance evaluations of AI systems.
4. **Lack of diversity among developers and contributors**:
- The developers and contributors of AI systems are mainly from a few developed countries and regions, lacking global diversity. This imbalance may lead to the neglect of the needs of many cultural and social groups in model design.
- The incentive mechanisms for developers are also biased towards certain specific groups, further exacerbating this problem.
5. **Security and the spread of harmful stereotypes**:
- AI models are vulnerable to security vulnerabilities and may spread harmful stereotypes, especially in low - resource languages and cultural backgrounds, where these problems are more prominent.
- The model may unintentionally reinforce social prejudices, such as those related to race, gender, and ethnicity.
### Goals of the paper
The authors propose a vision of creating AI systems that are **for everyone, with everyone's participation, and serving everyone**. Specific goals include:
- **For Everyone**: Ensure that AI systems can represent all groups of people, have consistent performance across groups, and adopt inclusive evaluation metrics and culturally diverse benchmark tests.
- **With Everyone**: Rely on diverse data sources and annotators to ensure the inclusiveness of the data and annotation processes.
- **By Everyone**: The teams that design and develop AI systems should have global diversity to ensure that applications can truly reflect the needs in real - life.
By solving the above problems, the authors hope to promote the development of AI technology to be more fair, inclusive, and sustainable, so as to better serve all groups around the world.