Engaging with Children's Artwork in Mixed Visual-Ability Families

Arnavi Chheda-Kothary,Jacob O. Wobbrock,Jon E. Froehlich

2024-07-30

Abstract:We present two studies exploring how blind or low-vision (BLV) family members engage with their sighted children's artwork, strategies to support understanding and interpretation, and the potential role of technology, such as AI, therein. Our first study involved 14 BLV individuals, and the second included five groups of BLV individuals with their children. Through semi-structured interviews with AI descriptions of children's artwork and multi-sensory design probes, we found that BLV family members value artwork engagement as a bonding opportunity, preferring the child's storytelling and interpretation over other nonvisual representations. Additionally, despite some inaccuracies, BLV family members felt that AI-generated descriptions could facilitate dialogue with their children and aid self-guided art discovery. We close with specific design considerations for supporting artwork engagement in mixed visual-ability families, including enabling artwork access through various methods, supporting children's corrections of AI output, and distinctions in context vs. content and interpretation vs. description of children's artwork.

Human-Computer Interaction,Artificial Intelligence

What problem does this paper attempt to address?

The paper primarily explores how blind or low vision (BLV) family members interact with, understand, and interpret the artworks created by their sighted children. The study was conducted in two phases:

1. **Study 1**: Included 14 BLV family members (parents and non-parent relatives) and used semi-structured interviews to understand their current methods, motivations, and tools and techniques used to interact with their children's artworks.

- **Current Practices**: Most participants learned about the artworks by talking to their children, and some also asked sighted adult partners for more information. Some low vision individuals tried to better observe the artworks by taking photos and enlarging the details. A few participants used technological tools like Seeing AI or Be My Eyes to get descriptions.

- **Motivations**: The common motivation among participants was to establish an emotional connection with their children and to track their growth and development by understanding their artworks.

- **Other Methods**: Besides verbal communication, some participants used other sensory methods to explore the artworks, such as having their children guide their hands to touch the outlines of the artworks or using scented markers to make the artworks "smellable."

2. **Study 2**: Based on the first phase, selected participants and their children were further studied, focusing on the process of children creating and sharing artworks and the adult-child interactions. This part of the study also included collecting feedback on AI-generated descriptions of artworks and design probe experiments on preferences for different technological representations.

Key findings of the paper include:
- BLV family members highly value establishing an emotional connection with their children through artworks.
- Children actively adapt to the needs of BLV family members, considering accessibility factors in their creations.
- Despite inaccuracies in AI-generated descriptions, most BLV family members found these descriptions valuable, as they facilitated conversations with their children and aided in self-guided art exploration.
- With the help of technology, BLV family members can enhance their interaction experience with their children's artworks in various ways.

In summary, the paper aims to deeply understand how BLV members in mixed-vision families engage with and comprehend the artworks created by their children and explores the potential role of technology (especially artificial intelligence) in this process.