Game Design Prototype with GIMs: Fostering Neurodiverse Connections through Storytelling

Yiqi Xiao
2024-08-26
Abstract:This ongoing experimental project investigates the use of Generative Image Models (GIMs) in crafting a picture book creation game designed to nurture social connections among autistic children and their neurotypical peers within a neuro-affirming environment. Moving away from traditional methods that often seek to condition neurodivergent children to socialize in prescribed ways, this project strives to cultivate a space where children can engage with one another naturally and creatively through art and storytelling, free from the pressure to adhere to standard social norms. Beyond merely "story-choosing," the research highlights the potential of GIMs to facilitate "story-creating," fostering peer social connections in a creative and structured collaborative learning experience.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem this paper attempts to address is: How to use Generative Image Models (GIMs) to design a digital picture book creation game to promote social connections between children with autism and neurotypical peers. Specifically, the study aims to create a space that supports children with autism to interact naturally and creatively with their peers through art and storytelling, rather than forcing them to act according to traditional social norms. ### Background and Motivation 1. **Social Needs of Children with Autism**: - Children with autism face challenges in forming friendships and participating in peer networks, which affects their overall development and well-being. - Despite this, research shows that children with autism still desire friendships and can form relationships with both neurotypical and autistic peers, albeit in different ways. 2. **Relationship Between Children with Autism and Digital Games**: - Due to difficulties with face-to-face communication, children with autism tend to express themselves and relax in online spaces. - Digital games provide opportunities to support the social needs of children with autism through interventions on familiar platforms. 3. **Application of AI Technology**: - The application of AI technology in the field of education has significantly improved the efficiency of personalized and inclusive education. - However, the application of AI in special education is relatively limited, especially in supporting children with autism. ### Project Overview - **Research Question**: How to use generative AI to create an experience that promotes connections between neurodiverse and neurotypical school-aged children? - **Project Introduction**: This project developed a hybrid learning experience that includes two stages: online creation of digital picture books and offline collaborative storytelling. - **Story Background**: Inspired by the nursery rhyme "Jack and Jill," it describes the story of two children embarking on an adventure together, emphasizing equal and diverse connections. - **Game Mechanism**: Players create and name their own characters and start the adventure through a series of choices that will affect the development of the story. - **Outcome**: The completed digital picture books will be printed and sent to each child's home or classroom as a tool for further creative interaction. ### Design Principles 1. **No Text and No Judgment**: Create a space without social pressure or fear of failure, allowing children with autism to express themselves confidently. 2. **Visual Experience**: Through the art elements generated by GIMs, players can explore the meaning of each visual choice and its impact on the story. 3. **Creation Rather Than Selection**: Players are not just choosing an adventure but creating their own adventure. ### Data Collection - **Qualitative Data**: Collected from field observations, completed digital picture books, and storytelling records. - **Questionnaire**: Caregivers of participating children are given questionnaires to understand their experiences after the game. ### Discussion - This project is not only suitable for children with autism but also for other neurodiverse children facing similar social challenges, as well as neurotypical children who prefer artistic creation. - The collected data can help scholars gain deeper insights into children's behaviors, such as self-expression, creativity, learning, and social interaction. ### Conclusion - This paper proposes a prototype of a digital picture book creation game using GIMs, aiming to create a structured and collaborative learning experience between children with autism and their neurotypical peers. - This innovative game approach promotes neurodiverse communication by providing a structured yet flexible environment, enabling children with autism to creatively build peer relationships.