"I'm Not Confident in Debiasing AI Systems Since I Know Too Little": Teaching AI Creators About Gender Bias Through Hands-on Tutorials

Kyrie Zhixuan Zhou,Jiaxun Cao,Xiaowen Yuan,Daniel E. Weissglass,Zachary Kilhoffer,Madelyn Rose Sanfilippo,Xin Tong
2023-09-15
Abstract:Gender bias is rampant in AI systems, causing bad user experience, injustices, and mental harm to women. School curricula fail to educate AI creators on this topic, leaving them unprepared to mitigate gender bias in AI. In this paper, we designed hands-on tutorials to raise AI creators' awareness of gender bias in AI and enhance their knowledge of sources of gender bias and debiasing techniques. The tutorials were evaluated with 18 AI creators, including AI researchers, AI industrial practitioners (i.e., developers and product managers), and students who had learned AI. Their improved awareness and knowledge demonstrated the effectiveness of our tutorials, which have the potential to complement the insufficient AI gender bias education in CS/AI courses. Based on the findings, we synthesize design implications and a rubric to guide future research, education, and design efforts.
Computers and Society,Human-Computer Interaction,Artificial Intelligence
What problem does this paper attempt to address?
This paper aims to address the prevalent issue of gender bias in artificial intelligence systems. Specifically, the researchers have designed interactive tutorials to raise awareness among AI creators about gender bias and to enhance their knowledge regarding the sources of gender bias and techniques to mitigate it. Current computer science and AI curricula fail to adequately educate students on how to identify and reduce gender bias, resulting in many AI developers lacking the necessary knowledge and awareness to avoid gender bias during the development process. Therefore, this paper aims to fill this educational gap by designing and evaluating these interactive tutorials, providing guidance for future research, education, and design practices. The main contributions of the paper include: 1. Designing and evaluating the first set of interactive tutorials aimed at AI creators to raise their awareness and technical knowledge about gender bias in AI. 2. Revealing the inadequacies of current AI gender bias education and calling for more attention to this area. 3. Providing design suggestions and evaluation criteria, offering references for future educational tools and research. Through these tutorials, the researchers hope not only to enhance the awareness and knowledge levels of AI creators but also to encourage them to pay more attention to gender equality in actual development, thereby developing more fair and unbiased AI systems.