Abstract:Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that is characterized by abnormalities in the brain, leading to difficulties in social interaction and communication, as well as learning and attention. Early diagnosis of ASD is challenging as it mainly relies on detecting abnormalities in brain function, which may not be evident in the early stages of the disorder. Facial expression analysis has shown promise as an alternative and efficient solution for early diagnosis of ASD, as children with ASD often exhibit distinctive patterns that differentiate them from typically developing children. Assistive technology has emerged as a crucial tool in improving the quality of life for individuals with ASD. In this study, we developed a real-time emotion identification system to detect the emotions of autistic children in case of pain or anger. The emotion recognition system consists of three stages: face identification, facial feature extraction, and feature categorization. The proposed system can detect six facial emotions: anger, fear, joy, natural, sadness, and surprise. To achieve high-performance accuracy in classifying the input image efficiently, we proposed a deep convolutional neural network (DCNN) architecture for facial expression recognition. An autoencoder was used for feature extraction and feature selection, and a pre-trained model (ResNet, MobileNet, and Xception) was applied due to the size of the dataset. The Xception model achieved the highest performance, with an accuracy of 0.9523%, sensitivity of 0.932, specificity of 0.9421, and AUC of 0.9134%. The proposed emotion detection framework leverages fog and IoT technologies to reduce latency for real-time detection with fast response and location awareness. Using fog computing is particularly useful when dealing with big data. Our study demonstrates the potential of using facial expression analysis and deep learning algorithms for real-time emotion recognition in autistic children, providing medical experts and families with a valuable tool for improving the quality of life for individuals with ASD.

SemConv: Deep Learning for Emotion Decoding in Autism Individuals using CNN

Interpretable SincNet-based Deep Learning for Emotion Recognition from EEG brain activity

Real-time facial emotion recognition model based on kernel autoencoder and convolutional neural network for autism children

Deep learning autism classification and prediction

Evaluation of Interpretability for Deep Learning algorithms in EEG Emotion Recognition: A case study in Autism

Transfer Learning and Hybrid Deep Convolutional Neural Networks Models for Autism Spectrum Disorder Classification From EEG Signals

Exploring the pattern of Emotion in children with ASD as an early biomarker through Recurring-Convolution Neural Network (R-CNN)

Real-time facial emotion recognition system among children with autism based on deep learning and IoT

Channels and Features Identification: A Review and a Machine-Learning Based Model With Large Scale Feature Extraction for Emotions and ASD Classification

An Automatic Framework For Detecting Autism Spectrum Disorder From EEG Signals Using TFD

Enhancing Autism Spectrum Disorder Diagnosis through a Novel 1D CNN-Based Deep Learning Classifier

ASD-SAENet: A Sparse Autoencoder, and Deep-Neural Network Model for Detecting Autism Spectrum Disorder (ASD) Using fMRI Data

Hybrid deep models for parallel feature extraction and enhanced emotion state classification

SENSES-ASD: a social-emotional nurturing and skill enhancement system for autism spectrum disorder

Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolution Neural Network

EEG-ConvNet: Convolutional networks for EEG-based subject-dependent emotion recognition

Classification and Detection of Autism Spectrum Disorder Based on Deep Learning Algorithms

A novel machine learning based framework for detection of Autism Spectrum Disorder (ASD)

AI-Powered Human-Computer Interaction Assisting Early Identification of Emotional and Facial Symptoms of Autism Spectrum Disorder in Children: “A Deep Learning-Based Enhanced Facial Feature Recognition System”

Deep learning-based feature selection and prediction system for autism spectrum disorder using a hybrid meta-heuristics approach

Emotion recognition using effective connectivity and pre-trained convolutional neural networks in EEG signals