Abstract:Traditional training methods such as card teaching, assistive technologies (e.g., augmented reality/virtual reality games and smartphone apps), DVDs, human-computer interactions, and human-robot interactions are widely applied in autistic rehabilitation training in recent years. In this article, we propose a novel framework for human-computer/robot interaction and introduce a preliminary intervention study for improving the emotion recognition of Chinese children with an autism spectrum disorder. The core of the framework is the Facial Emotion Cognition and Training System (FECTS, including six tasks to train children with ASD to match, infer, and imitate the facial expressions of happiness, sadness, fear, and anger) based on Simon Baron-Cohen's E-S (empathizing-systemizing) theory. Our system may be implemented on PCs, smartphones, mobile devices such as PADs, and robots. The training record (e.g., a tracked record of emotion imitation) of the Chinese autistic children interacting with the device implemented using our FECTS will be uploaded and stored in the database of a cloud-based evaluation system. Therapists and parents can access the analysis of the emotion learning progress of these autistic children using the cloud-based evaluation system. Deep-learning algorithms of facial expressions recognition and attention analysis will be deployed in the back end (e.g., devices such as a PC, a robotic system, or a cloud system) implementing our FECTS, which can perform real-time tracking of the imitation quality and attention of the autistic children during the expression imitation phase. In this preliminary clinical study, a total of 10 Chinese autistic children aged 3-8 are recruited, and each of them received a single 20-minute training session every day for four consecutive days. Our preliminary results validated the feasibility of the developed FECTS and the effectiveness of our algorithms based on Chinese children with an autism spectrum disorder. To verify that our FECTS can be further adapted to children from other countries, children with different cultural/sociological/linguistic contexts should be recruited in future studies.

An EEG-based Adaptive Training System for ASD Children

Toon-chat

FECTS: A Facial Emotion Cognition and Training System for Chinese Children with Autism Spectrum Disorder

A VR-based Training and Intelligent Assessment System Integrated with Multi-modal Sensing for Children with Autism Spectrum Disorder

FaceMe: an Augmented Reality Social Agent Game for Facilitating Children's Learning about Emotional Expressions

Avatar-Based Picture Exchange Communication System Enhancing Joint Attention Training for Children with Autism

Feasibility of Automated Training for Facial Emotion Expression and Recognition in Autism

Assisting Autistic Children with Wireless EOG Technology.

An Auxiliary Screening System for Autism Spectrum Disorder Based on Emotion and Attention Analysis

Toward Improving Social Interaction Ability for Children with Autism Spectrum Disorder Using Social Signals

EEG decoding for effects of visual joint attention training on ASD patients with interpretable and lightweight convolutional neural network

Assisted therapeutic system based on reinforcement learning for children with autism

Design and Implementation of ASD Children's Cognitive Education System Based on Unity3D

Cognitive Wearable Robotics for Autism Perception Enhancement

Computer-Aided Autism Spectrum Disorder Diagnosis With Behavior Signal Processing

Designing Mobile EEG Neurofeedback Games for Children with Autism

Towards Automatic Engagement Recognition of Autistic Children in a Machine Learning Approach.

Children ASD Evaluation Through Joint Analysis of EEG and Eye-Tracking Recordings with Graph Convolution Network

Electroencephalography Connectivity Assesses Cognitive Disorders of Autistic Children During Game-Based Social Interaction

Characterizing Autism Spectrum Disorder Through Fusion of Local Cortical Activation and Global Functional Connectivity Using Game-Based Stimuli and a Mobile EEG System

Deep Interaction: Wearable Robot-Assisted Emotion Communication for Enhancing Perception and Expression Ability of Children with Autism Spectrum Disorders