Abstract:Non-speaking autistic individuals grapple with the profound impact of the 'double empathy problem' in their daily interactions with speaking others. This study rethinks the communication challenges faced by non-speaking autistic individuals, challenging traditional approaches that predominantly focus on speech and complex communication devices (AAC). By spotlighting the natural phenomenon of "interactive stimming," a powerful mode of communication among autistic individuals, this study advocates for a shift from a conventional emphasis on speech towards the foundational role of the body in autistic communication. Central to this exploration is the introduction of the Magical Musical Mat (MMM), an innovative interactive environment mapping interpersonal touch to musical sounds. Through a robust mixed-methods approach integrating video-based fieldwork and design-based research, this paper engages three non-speaking autistic children and their mothers in a 5-day empirical intervention. Results reveal significant transformations in parent–child interactions as both parents and children are acquainted with touch in a new environment. Children assert their autonomy, exploring at their own pace, and discovering sensory features of the environment. Notably, the introduction of sound prompts heightened awareness of the stims, leading to diversified and expressive stim movements. Foregrounding interpersonal touch eventually guides parents into their children's sensory activities where parents attune to the stims of their children by joining in and facilitating their expressiveness, co-creating extended, evolving patterns of repetitive cycles. The collaborative stim cycles can be likened to free improvisation, where dynamical coherence between individuals occurs through a blend of stability and active flexibility. By shifting the focus from speech to co-created sensory experiences, this paper sheds light on the value of transformative multisensory environments, envisioning a world where varied modes of communication are valued and embraced.

EmoBridge: Bridging the Communication Gap between Students with Disabilities and Peer Note-Takers Utilizing Emojis and Real-Time Sharing

EmoSparkle: Tangible Prototype to Convey Visual Expressions for Visually Impaired Individuals in Real-time Conversations.

Emoji Use as a Catalyst for Relationship Building and Sustaining Attention in Online Classes: An Empirical Study

Inclusive Emotion Technologies: Addressing the Needs of d/Deaf and Hard of Hearing Learners in Video-Based Learning

Learners’ perceived advantages and social-affective dispositions toward online peer feedback in academic writing

NaMemo2: Facilitating Teacher-Student Interaction with Theory-Based Design and Student Autonomy Consideration

Studying online with special needs: A student perspective

Embracing emojis: Bridging the gap in workplace technology adoption and elevating communication effectiveness

BioBridge: Unified Bio-Embedding with Bridging Modality in Code-Switched EMR

Exploring Communication Dynamics: Eye-tracking Analysis in Pair Programming of Computer Science Education

A Synchronous Communication Experiment within an Online Distance Learning Program: A Case Study

Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysis

Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing Pairs

Gifted School Activities With DropTalk, Parent-Teacher Notebook, and SmileNote for Students With Disabilities

AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cues

PATHWiSE: An Authoring Tool to Support Teachers to Create Robot-Supported Social Learning Experiences During Homework

Using a digital whiteboard for student engagement in distance education

Making room for interactivity: using the cloud-based audience response system Nearpod to enhance engagement in lectures

Bridging the gap: fostering interactive stimming between non-speaking autistic children and their parents

Collaborative programming problem-solving in augmented reality: Multimodal analysis of effectiveness and group collaboration