Abstract:Traditional training methods such as card teaching, assistive technologies (e.g., augmented reality/virtual reality games and smartphone apps), DVDs, human-computer interactions, and human-robot interactions are widely applied in autistic rehabilitation training in recent years. In this article, we propose a novel framework for human-computer/robot interaction and introduce a preliminary intervention study for improving the emotion recognition of Chinese children with an autism spectrum disorder. The core of the framework is the Facial Emotion Cognition and Training System (FECTS, including six tasks to train children with ASD to match, infer, and imitate the facial expressions of happiness, sadness, fear, and anger) based on Simon Baron-Cohen's E-S (empathizing-systemizing) theory. Our system may be implemented on PCs, smartphones, mobile devices such as PADs, and robots. The training record (e.g., a tracked record of emotion imitation) of the Chinese autistic children interacting with the device implemented using our FECTS will be uploaded and stored in the database of a cloud-based evaluation system. Therapists and parents can access the analysis of the emotion learning progress of these autistic children using the cloud-based evaluation system. Deep-learning algorithms of facial expressions recognition and attention analysis will be deployed in the back end (e.g., devices such as a PC, a robotic system, or a cloud system) implementing our FECTS, which can perform real-time tracking of the imitation quality and attention of the autistic children during the expression imitation phase. In this preliminary clinical study, a total of 10 Chinese autistic children aged 3-8 are recruited, and each of them received a single 20-minute training session every day for four consecutive days. Our preliminary results validated the feasibility of the developed FECTS and the effectiveness of our algorithms based on Chinese children with an autism spectrum disorder. To verify that our FECTS can be further adapted to children from other countries, children with different cultural/sociological/linguistic contexts should be recruited in future studies.

SpecialTime: Automatically Detecting Dialogue Acts from Speech to Support Parent-Child Interaction Therapy

Curating feedback for parents based on interactions during parent–child book reading activities

Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes

Speaker and Time-aware Joint Contextual Learning for Dialogue-act Classification in Counselling Conversations

Parent implementation of a treatment for late talkers based on cross-situational statistical learning principles: Treatment fidelity and acceptability

Open-Trial Pilot of Parent-Child Interaction Therapy for Children With Autism Spectrum Disorder

An 18-week model of Parent-Child Interaction Therapy: clinical approaches, treatment formats, and predictors of success for predominantly minoritized families

PsyChat: A Client-Centric Dialogue System for Mental Health Support

FECTS: A Facial Emotion Cognition and Training System for Chinese Children with Autism Spectrum Disorder

Automated evaluation of psychotherapy skills using speech and language technologies

Accuracy of Automatic Processing of Speech-Language Pathologist and Child Talk During School-Based Therapy Sessions

ASD-Chat: An Innovative Dialogue Intervention System for Children with Autism based on LLM and VB-MAPP

A Dialogue System for Assessing Activities of Daily Living: Improving Consistency with Grounded Knowledge

Automatic speaker diarization for natural conversation analysis in autism clinical trials

Enhancing Autism Spectrum Disorder Early Detection with the Parent-Child Dyads Block-Play Protocol and an Attention-enhanced GCN-xLSTM Hybrid Deep Learning Framework

Parent–Child Interaction Therapy with Toddlers: A Community-based Randomized Controlled Trial with Children Aged 14-24 Months

A Benchmark for Understanding Dialogue Safety in Mental Health Support

Teaching Parents via Online Asynchronous Training to Use Speech-Generating Devices with Their Autistic Children: A Pilot Study

Emulating real-life situations with a play task to observe parenting skills and child behaviors.

A Preliminary Study of Voicebot to Assist ADHD Children in Performing Daily Tasks