Abstract:The rapid expansion of Artificial Intelligence (AI) technologies has introduced both significant advancements and challenges, with diversity and inclusion (D&I) emerging as a critical concern. Addressing D&I in AI is essential to reduce biases and discrimination, enhance fairness, and prevent adverse societal impacts. Despite its importance, D&I considerations are often overlooked, resulting in incidents marked by built-in biases and ethical dilemmas. Analyzing AI incidents through a D&I lens is crucial for identifying causes of biases and developing strategies to mitigate them, ensuring fairer and more equitable AI technologies. However, systematic investigations of D&I-related AI incidents are scarce. This study addresses these challenges by identifying and understanding D&I issues within AI systems through a manual analysis of AI incident databases (AIID and AIAAIC). The research develops a decision tree to investigate D&I issues tied to AI incidents and populate a public repository of D&I-related AI incidents. The decision tree was validated through a card sorting exercise and focus group discussions. The research demonstrates that almost half of the analyzed AI incidents are related to D&I, with a notable predominance of racial, gender, and age discrimination. The decision tree and resulting public repository aim to foster further research and responsible AI practices, promoting the development of inclusive and equitable AI systems.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: In artificial intelligence (AI) technology, how to identify and understand issues related to diversity (D) and inclusion (I), and propose strategies to reduce prejudice and discrimination, improve fairness and prevent adverse social impacts. Specifically, by analyzing cases in the AI accident database, the paper aims to identify AI accidents related to diversity and inclusion, and develop tools and methods to promote more responsible AI practices. ### Specific Background of the Problem With the rapid development of AI technology, diversity and inclusion (D&I) has become a key issue. Ignoring D&I may lead to built - in biases, ethical dilemmas, and unfair social impacts. Although the importance of D&I is increasingly prominent, research on systematically investigating AI accidents related to D&I is still insufficient. Therefore, this paper aims to fill this research gap and solve the problem in the following ways: 1. **Identify AI Accidents Related to D&I**: Through manual analysis of two AI accident databases (AIID and AIAAIC), classify accidents related to D&I. 2. **Develop Analytical Tools**: Create a decision tree to investigate D&I issues in AI accidents, and verify its effectiveness through card sorting and focus group discussions. 3. **Create a Public Repository**: Design and publish a public repository containing AI accidents related to D&I, providing a valuable resource for future research. 4. **Explore the Root Causes of D&I - related AI Accidents**: By analyzing these accidents, reveal the reasons behind them, and thus propose strategies to avoid similar accidents. 5. **Promote Responsible AI Practices**: Increase the awareness of researchers and practitioners of the importance of embedding D&I principles, and promote the development of more inclusive and fair AI technology. ### Main Contributions of the Research - **Identify D&I - related AI Accidents**: Establish standards and explore two AI accident databases, classify accidents related to D&I, and provide classification reasons and involved diversity attributes. - **Develop Analytical Tools**: Create and verify a decision tree for investigating D&I issues in AI accidents. - **Create a Public Repository**: Develop an open D&I - related AI accident repository. - **Explore Root Causes**: Reveal the causes of D&I - related AI accidents, which helps to propose strategies to avoid these accidents. - **Promote Responsible AI Practices**: Strengthen the awareness of researchers and practitioners of the importance of comprehensively embedding D&I principles, and promote the development of more inclusive and fair AI technology. Through these efforts, the paper hopes to provide valuable guidance for future AI research and practice, ensuring that AI technology is more fair, inclusive and responsible.

AI for All: Identifying AI incidents Related to Diversity and Inclusion

Challenges and Solutions in AI for All

AI and the quest for diversity and inclusion: a systematic literature review

AI for All: Operationalising Diversity and Inclusion Requirements for AI Systems

Lessons for Editors of AI Incidents from the AI Incident Database

Diversity, Equity, and Inclusion in Artificial Intelligence: An Evaluation of Guidelines

The AI Incident Database as an Educational Tool to Raise Awareness of AI Harms: A Classroom Exploration of Efficacy, Limitations, & Future Improvements

Diversity and Inclusion in AI for Recruitment: Lessons from Industry Workshop

Intersectionality in Artificial Intelligence: Framing Concerns and Recommendations for Action

Diversity and Inclusion in Artificial Intelligence

Does AI Debias Recruitment? Race, Gender, and AI's "Eradication of Difference"

Ethical artificial intelligence (AI): confronting bias and discrimination in the library and information industry

Fairness in AI-Driven Recruitment: Challenges, Metrics, Methods, and Future Directions

Data quality dimensions for fair AI

Addressing Bias and Fairness Issues in Artificial Intelligence

A Vision for Operationalising Diversity and Inclusion in AI

Bias in data‐driven artificial intelligence systems—An introductory survey

AI and Identity

Artificial Intelligence Incidents & Ethics A Narrative Review

No computation without representation: Avoiding data and algorithm biases through diversity

Artificial Intelligence and Inequality: Challenges and Opportunities