Navigating Fairness: Practitioners' Understanding, Challenges, and Strategies in AI/ML Development

Aastha Pant,Rashina Hoda,Chakkrit Tantithamthavorn,Burak Turhan

2024-07-31

Abstract:The rise in the use of AI/ML applications across industries has sparked more discussions about the fairness of AI/ML in recent times. While prior research on the fairness of AI/ML exists, there is a lack of empirical studies focused on understanding the perspectives and experiences of AI practitioners in developing a fair AI/ML system. Understanding AI practitioners' perspectives and experiences on the fairness of AI/ML systems are important because they are directly involved in its development and deployment and their insights can offer valuable real-world perspectives on the challenges associated with ensuring fairness in AI/ML systems. We conducted semi-structured interviews with 22 AI practitioners to investigate their understanding of what a 'fair AI/ML' is, the challenges they face in developing a fair AI/ML system, the consequences of developing an unfair AI/ML system, and the strategies they employ to ensure AI/ML system fairness. We developed a framework showcasing the relationship between AI practitioners' understanding of 'fair AI/ML' system and (i) their challenges in its development, (ii) the consequences of developing an unfair AI/ML system, and (iii) strategies used to ensure AI/ML system fairness. By exploring AI practitioners' perspectives and experiences, this study provides actionable insights to enhance AI/ML fairness, which may promote fairer systems, reduce bias, and foster public trust in AI technologies. Additionally, we also identify areas for further investigation and offer recommendations to aid AI practitioners and AI companies in navigating fairness.

Computers and Society,Artificial Intelligence,Software Engineering

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to understand the challenges, their understandings and strategies faced by AI practitioners in the process of developing fair artificial intelligence/machine learning (AI/ML) systems. Specifically, the research explored four main aspects through semi - structured interviews:

1. **AI Practitioners' Understanding of "Fair AI/ML"**: The researchers asked AI practitioners how they defined or understood "fair AI/ML" in order to understand their viewpoints and cognitions in actual work.

2. **Challenges in Developing Fair AI/ML Systems**: The research explored the specific obstacles and difficulties encountered by AI practitioners when attempting to build fair AI/ML systems, as well as the factors causing these challenges.

3. **Consequences of Developing Unfair AI/ML Systems**: The researchers also investigated how AI practitioners viewed the possible impacts and consequences of developing unfair AI/ML systems, which helps to assess the impact of unfair AI systems on society and individuals.

4. **Strategies for Ensuring the Fairness of AI/ML Systems**: Finally, the researchers collected the practical methods and strategies used by AI practitioners to ensure that the AI/ML systems they develop meet fairness standards.

Through these explorations, the research aims to provide practical insights, help improve the fairness of AI/ML systems, reduce biases, and enhance public trust in AI technology. In addition, the research also aims to identify areas for further research and make recommendations to help AI practitioners and AI companies better address fairness issues.