Abstract:The automatic facial expression tracking method has become an emergent topic during the last few decades. It is a challenging problem that impacts many fields such as virtual reality, security surveillance, driver safety, homeland security, human-computer interaction, medical applications. A remarkable cost-efficiency can be achieved by considering some areas of a face. These areas are termed Active Regions of Interest (AROIs). This work proposes a facial expression recognition framework that investigates five types of facial expressions, namely neutral, happiness, fear, surprise, and disgust. Firstly, a pose estimation method is incorporated and to go along with an approach to rotate the face to achieve a normalized pose. Secondly, the whole face-image is segmented into four classes and eight regions. Thirdly, only four AROIs are identified from the segmented regions. The four AROIs are the nose-tip, right eye, left eye, and lips respectively. Fourthly, an info-image-data-mask database is maintained for classification and it is used to store records of images. This database is the mixture of all the images that are gained after introducing a ten-fold cross-validation technique using the Convolutional Neural Network. Correlations of variances and standard deviations are computed based on identified images. To minimize the required processing time in both training and testing the data set, a parallelism technique is introduced, in which each region of the AROIs is classified individually and all of them run in parallel. Fifthly, a decision-tree-level synthesis-based framework is proposed to coordinate the results of parallel classification, which helps to improve the recognition accuracy. Finally, experimentation on both independent and synthesis databases is voted for calculating the performance of the proposed technique. By incorporating the proposed synthesis method, we gain 94.499%, 95.439%, and 98.26% accuracy with the CK+ image sets and 92.463%, 93.318%, and 94.423% with the JAFFE image sets. The overall accuracy is 95.27% in recognition. We gain 2.8% higher accuracy by introducing a decision-level synthesis method. Moreover, with the incorporation of parallelism, processing time speeds up three times faster. This accuracy proves the robustness of the proposed scheme.

Facial Expression Recognition with High Response-Based Local Directional Pattern (HR-LDP) Network

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

A novel Leaky Rectified Triangle Linear Unit based Deep Convolutional Neural Network for facial emotion recognition

Image-Based Facial Expression Recognition Using Local Neighborhood Difference Binary Pattern

Facial emotion recognition using hybrid features-novel leaky rectified triangle linear unit activation function based deep convolutional neural network

An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier

Facial expression recognition using HOG and LBP features with convolutional neural network

Facial expression recognition based on active region of interest using deep learning and parallelism

A novel modular deep fully convolutional network for efficient low resolution facial expression recognition

A deep-learning-based facial expression recognition method using textural features

Human facial emotion recognition using improved black hole based extreme learning machine

Facial Expression Recognition with LBP and ORB Features

Effective Facial Expression Recognition System Using Machine Learning

Deep learning based efficient emotion recognition technique for facial images

Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks

Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network

A comparative study on facial expression recognition using local binary patterns, convolutional neural network and frequency neural network

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

Impact of self adaptive-elephant herding optimization towards neural network for facial emotion recognition

Hierarchical Spatial Pyramidal Feature Representation Learning for Facial Expression Recognition