A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons

Mohammad Rafayet Ali,Zahra Razavi,Abdullah Al Mamun,Raina Langevin,Benjamin Kane,Reza Rawassizadeh,Lenhart Schubert,M Ehsan Hoque
DOI: https://doi.org/10.1145/3383652.3423900
2020-10-07
Abstract:We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the social skills training for adolescents with Autism Spectrum Disorder (ASD). Specifically, the paper presents the design and experimental results of an online social skills development interface named LISSA (Live Interactive Social Skills Assistance). This virtual conversation agent aims to provide a private conversation practice environment at any time and any place through a web browser, helping ASD adolescents improve their social skills. Users can have informal conversations with the virtual agent and receive real - time feedback on non - verbal cues as well as post - conversation summary feedback. In addition, the paper also explores the key considerations in designing this system, such as the actual appearance of the system, response speed, conversation personalization, etc. These factors are crucial for increasing user engagement. Through research with 9 high - functioning ASD adolescents, the author identifies several key design guidelines to guide future system development.