Abstract:The automatic facial expression tracking method has become an emergent topic during the last few decades. It is a challenging problem that impacts many fields such as virtual reality, security surveillance, driver safety, homeland security, human-computer interaction, medical applications. A remarkable cost-efficiency can be achieved by considering some areas of a face. These areas are termed Active Regions of Interest (AROIs). This work proposes a facial expression recognition framework that investigates five types of facial expressions, namely neutral, happiness, fear, surprise, and disgust. Firstly, a pose estimation method is incorporated and to go along with an approach to rotate the face to achieve a normalized pose. Secondly, the whole face-image is segmented into four classes and eight regions. Thirdly, only four AROIs are identified from the segmented regions. The four AROIs are the nose-tip, right eye, left eye, and lips respectively. Fourthly, an info-image-data-mask database is maintained for classification and it is used to store records of images. This database is the mixture of all the images that are gained after introducing a ten-fold cross-validation technique using the Convolutional Neural Network. Correlations of variances and standard deviations are computed based on identified images. To minimize the required processing time in both training and testing the data set, a parallelism technique is introduced, in which each region of the AROIs is classified individually and all of them run in parallel. Fifthly, a decision-tree-level synthesis-based framework is proposed to coordinate the results of parallel classification, which helps to improve the recognition accuracy. Finally, experimentation on both independent and synthesis databases is voted for calculating the performance of the proposed technique. By incorporating the proposed synthesis method, we gain 94.499%, 95.439%, and 98.26% accuracy with the CK+ image sets and 92.463%, 93.318%, and 94.423% with the JAFFE image sets. The overall accuracy is 95.27% in recognition. We gain 2.8% higher accuracy by introducing a decision-level synthesis method. Moreover, with the incorporation of parallelism, processing time speeds up three times faster. This accuracy proves the robustness of the proposed scheme.

Facial Expression Recognition Using YOLO

Emotional Facial Expression Detection using YOLOv8

Facial Emotion Detection: Applications, Advancements, and Implications in Human-Computer Interaction

Facial Human Emotion Recognition by Using YOLO Faces Detection Algorithm

Facial expression recognition based on active region of interest using deep learning and parallelism

Effective Facial Expression Recognition System Using Machine Learning

AutYOLO-ATT: an attention-based YOLOv8 algorithm for early autism diagnosis through facial expression recognition

Facial expression recognition using lightweight deep learning modeling

Facial expression recognition with trade-offs between data augmentation and deep learning features

Driving Alert System based on Facial Expression Recognition

Facial Expression Recognition With Fusion Features Extracted From Salient Facial Areas

Intelligent Driver Warning System using Deep Learning-based Facial Expression Recognition

Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods

Efficient Facial Expression Recognition Using Deep Learning Techniques

A real time face emotion classification and recognition using deep learning model

You Only Look Once: Unified, Real-Time Object Detection

YOLOv8: A Novel Object Detection Algorithm with Enhanced Performance and Robustness

A novel real time system for facial expression recognition

A Facial Expression Recognition System for Smart Learning Based on YOLO and Vision Transformer

FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space

Optimal Facial Feature Based Emotional Recognition Using Deep Learning Algorithm