Abstract:Artificial Intelligence (AI) tools are increasingly being used in education for various purposes. In particular, AI chatbots such as ChatGPT, with their user-friendly interfaces are being explored in education to co-create teaching materials, provide advice and guidance to educators, simulate classroom scenarios, and offer personalized recommendations to students on how to study and approach subjects. With all the enthusiasm for these new opportunities, one should be aware of the risks due to potential biases in the generated content or the responses. These biases can be associated with factors such as gender, race, religion, or political orientation. As a consequence, educators who are using AI chatbots to (co-)create teaching materials need to have the knowledge and the strategies to mitigate such biases. This paper focuses on one particular type of bias, namely gender bias, and on specific disciplines, namely Science, Technology, Engineering and Mathematics (STEM). Gender bias in STEM education is particularly problematic because it may reinforce existing stereotypes about girls and women in STEM and contribute to their underrepresentation in STEM fields. To raise awareness of these risks of gender bias in AI-co-created STEM teaching materials, this paper identifies risks of gender bias by analysing potential usage patterns of AI chatbots by educators when creating teaching materials. An example of such a risk is if the AI chatbot generates educational materials that primarily portray men as STEM professionals and underrepresent women. This would exacerbate the lack of female role models in STEM. Therefore, strategies are developed that educators can apply to mitigate these risks. These strategies will be demonstrated using practical examples. This will allow them to break the vicious cycle of perpetuating stereotypes in STEM education. In addition, these examples demonstrate how AI chatbots can be used to make STEM education more inclusive, which may include co-creating educational materials tailored to individual interests and learning styles.

Female Models in AI and the Fight Against COVID-19

Gender-Specific Patterns in the Artificial Intelligence Scientific Ecosystem

Gender Diversity in AI Research

The potential of artificial intelligence as an equalizer of gender disparity in surgical training and education

Inferior: The Challenges of Gender Parity in the Artificial Intelligence Ecosystem-A Case for Canada

Women, artificial intelligence, and key positions in collaboration networks: Towards a more equal scientific ecosystem

Raising awareness of sex and gender bias in artificial intelligence and health

The Uneven Access to COVID-19 Research for Women in Science

Mapping gender and geographic diversity in artificial intelligence research: Editor representation in leading computer science journals

The Gendered Lens of AI: Examining News Imagery Across Digital Spaces

Who makes AI? Gender and portrayals of AI scientists in popular film, 1920–2020

Feminist AI: Can We Expect Our AI Systems to Become Feminist?

Voices of Her: Analyzing Gender Differences in the AI Publication World

Authorship gender among articles about artificial intelligence in breast imaging

Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis

Big data and AI for gender equality in health: bias is a big challenge

The Soccer-Playing Unicorn – Mitigating Gender Bias in AI-Created STEM Teaching Materials

"I'm Not Confident in Debiasing AI Systems Since I Know Too Little": Teaching AI Creators About Gender Bias Through Hands-on Tutorials

Comparison of women and men in biomedical informatics scientific dissemination: retrospective observational case study of the AMIA Annual Symposium: 2017-2020

Artificial Intelligence and Women Researchers in the Czech Republic

Gender Equality in STEM: Exploring Self-Efficacy Through Gender Awareness