Abstract:The automatic facial expression tracking method has become an emergent topic during the last few decades. It is a challenging problem that impacts many fields such as virtual reality, security surveillance, driver safety, homeland security, human-computer interaction, medical applications. A remarkable cost-efficiency can be achieved by considering some areas of a face. These areas are termed Active Regions of Interest (AROIs). This work proposes a facial expression recognition framework that investigates five types of facial expressions, namely neutral, happiness, fear, surprise, and disgust. Firstly, a pose estimation method is incorporated and to go along with an approach to rotate the face to achieve a normalized pose. Secondly, the whole face-image is segmented into four classes and eight regions. Thirdly, only four AROIs are identified from the segmented regions. The four AROIs are the nose-tip, right eye, left eye, and lips respectively. Fourthly, an info-image-data-mask database is maintained for classification and it is used to store records of images. This database is the mixture of all the images that are gained after introducing a ten-fold cross-validation technique using the Convolutional Neural Network. Correlations of variances and standard deviations are computed based on identified images. To minimize the required processing time in both training and testing the data set, a parallelism technique is introduced, in which each region of the AROIs is classified individually and all of them run in parallel. Fifthly, a decision-tree-level synthesis-based framework is proposed to coordinate the results of parallel classification, which helps to improve the recognition accuracy. Finally, experimentation on both independent and synthesis databases is voted for calculating the performance of the proposed technique. By incorporating the proposed synthesis method, we gain 94.499%, 95.439%, and 98.26% accuracy with the CK+ image sets and 92.463%, 93.318%, and 94.423% with the JAFFE image sets. The overall accuracy is 95.27% in recognition. We gain 2.8% higher accuracy by introducing a decision-level synthesis method. Moreover, with the incorporation of parallelism, processing time speeds up three times faster. This accuracy proves the robustness of the proposed scheme.

Automatic Fiducial Points Detection for Multi-facial Expressions via Invariant Features and Multi-layer Kernel Sliding Perceptron

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Effective Facial Expression Recognition System Using Machine Learning

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

Recognition of facial expressions based on salient geometric features and support vector machines

Fully automatic 3D facial expression recognition using a region-based approach

A Robust Facial Expression Recognition Algorithm Based on Multi-Rate Feature Fusion Scheme

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Robust facial expression recognition system in higher poses

Facial expression recognition based on active region of interest using deep learning and parallelism

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks

A feature boosted deep learning method for automatic facial expression recognition

Human facial emotion recognition using improved black hole based extreme learning machine

Automated facial expression recognition using exemplar hybrid deep feature generation technique

Multi-facial patches aggregation network for facial expression recognition and facial regions contributions to emotion display

An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier

An automatic improved facial expression recognition for masked faces

Facial Expression Recognition: a Comparison with Different Classical and Deep Learning Methods

Automatic Analysis of Facial Expressions Based on Deep Covariance Trajectories