Design of an Intelligent Agent to Measure Collaboration and Verbal-Communication Skills of Children With Autism Spectrum Disorder in Collaborative Puzzle Games

Lian Zhang,Ashwaq Z. Amat,Huan Zhao,Amy Swanson,Amy Weitlauf,Zachary Warren,Nilanjan Sarkar
DOI: https://doi.org/10.1109/tlt.2020.3029223
2021-06-01
IEEE Transactions on Learning Technologies
Abstract:Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by core deficits in social interaction and communication. Collaborative puzzle games are interactive activities that can be played to foster the collaboration and verbal-communication skills of children with ASD. In this article, we have designed an intelligent agent that can play collaborative puzzle games with children and verbally communicate with them as if it is another human player. Furthermore, this intelligent agent is also able to automatically measure children's task-performance and verbal-communication behaviors throughout the game play. Two preliminary studies were conducted with children with ASD to evaluate the feasibility and performance of the intelligent agent. Results of Study I demonstrated the intelligent agent's ability to play games and communicate with children within the game-playing domain. Results of Study II indicated its potential to measure the communication and collaboration skills of human users.
education & educational research,computer science, interdisciplinary applications
What problem does this paper attempt to address?