Abstract:The automatic facial expression tracking method has become an emergent topic during the last few decades. It is a challenging problem that impacts many fields such as virtual reality, security surveillance, driver safety, homeland security, human-computer interaction, medical applications. A remarkable cost-efficiency can be achieved by considering some areas of a face. These areas are termed Active Regions of Interest (AROIs). This work proposes a facial expression recognition framework that investigates five types of facial expressions, namely neutral, happiness, fear, surprise, and disgust. Firstly, a pose estimation method is incorporated and to go along with an approach to rotate the face to achieve a normalized pose. Secondly, the whole face-image is segmented into four classes and eight regions. Thirdly, only four AROIs are identified from the segmented regions. The four AROIs are the nose-tip, right eye, left eye, and lips respectively. Fourthly, an info-image-data-mask database is maintained for classification and it is used to store records of images. This database is the mixture of all the images that are gained after introducing a ten-fold cross-validation technique using the Convolutional Neural Network. Correlations of variances and standard deviations are computed based on identified images. To minimize the required processing time in both training and testing the data set, a parallelism technique is introduced, in which each region of the AROIs is classified individually and all of them run in parallel. Fifthly, a decision-tree-level synthesis-based framework is proposed to coordinate the results of parallel classification, which helps to improve the recognition accuracy. Finally, experimentation on both independent and synthesis databases is voted for calculating the performance of the proposed technique. By incorporating the proposed synthesis method, we gain 94.499%, 95.439%, and 98.26% accuracy with the CK+ image sets and 92.463%, 93.318%, and 94.423% with the JAFFE image sets. The overall accuracy is 95.27% in recognition. We gain 2.8% higher accuracy by introducing a decision-level synthesis method. Moreover, with the incorporation of parallelism, processing time speeds up three times faster. This accuracy proves the robustness of the proposed scheme.

Facial Expression Recognition of Industrial Internet of Things by Parallel Neural Networks Combining Texture Features

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

The Image Annotation Method by Convolutional Features from Intermediate Layer of Deep Learning Based on Internet of Things

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

Facial Expression Recognition Based on Multi-Scale Convolutional Vision Transformer

Facial expression recognition based on deep learning

Facial Expression Recognition System Based On Deep Residual Fusion Neural Network

A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition

Using Feature Points and Angles Between Them to Recognise Facial Expression by a Neural Network Approach

Facial expression recognition based on active region of interest using deep learning and parallelism

TriCAFFNet: A Tri-Cross-Attention Transformer with a Multi-Feature Fusion Network for Facial Expression Recognition

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Two-pathway attention network for real-time facial expression recognition

A Novel Attention Residual Network Expression Recognition Method

A facial expression recognition network based on attention double branch enhanced fusion

Facial Expressions Recognition for Human-Robot Interaction Using Deep Convolutional Neural Networks with Rectified Adam Optimizer

Facial Expression Recognition System Based on Multiple Feature Integration

The Facial Expression Recognition Method Based on Image Fusion and CNN

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Pre-Trained Convolutional Neural Network Features for Facial Expression Recognition