Abstract:Facial expression recognition has received extensive attention in recent years due to its important applications in many fields. Most expression samples used in research are relatively easy to analyze emotions because they have explicit expressions with strong intensities. However, in situations such as video question and answer, business negotiation, polygraph detection in the security field, autism treatment and medical escort, emotions are expressed in suppressed manners with low intensive expression or subtle expressions, making it difficult to estimate emotions accurately. In these situations, how to effectively extract expression features from facial expression images is a critical problem that affects the accuracy of subtle expression recognition. To address this problem, we propose an end-to-end group adaptive attention model for subtle expression recognition. Cropping an image into several regions of interest (ROI) according to the correlations between facial skeleton and emotions, the proposed model analyses the relationship among regions of interest, and mutual relations between local regions and the holistic region. Using the region group adaptive attention mechanism, the model effectively trains the convolutional neural network to efficiently extract facial expressions representing features and increases the accuracy and robustness of the recognition, particularly in some subtle facial expression circumstances. To improve the ability of different regional features to discriminate expressions, a group adaptive loss function is introduced to verify and improve estimation accuracy. Extensive experiments are conducted on the existing public face datasets CK+, JAFFE, KDEF and the self-collected subtle expression dataset SFER. Results show that the proposed model achieves accuracies of 99.59%, 95.20%, and 93.47% with datasets CK+, JAFFE, and KDEF, respectively. The proposed model thus generally achieves better performance in facial expression recognition than other methods.

Overcoming Occlusion for Robust Facial Expression Recognition Using Adaptive Dual-Attention Net

Occlusion Aware Facial Expression Recognition Using CNN With Attention Mechanism

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Facial Expression Recognition from Occluded Images Using Deep Convolution Neural Network with Vision Transformer

Adaptive multilayer perceptual attention network for facial expression recognition

Adaptive Weight Based on Overlapping Blocks Network for Facial Expression Recognition

A Cascade Attention Based Facial Expression Recognition Network by Fusing Multi-Scale Spatio-Temporal Features

A facial expression recognition network based on attention double branch enhanced fusion

Hybrid Attention-Aware Learning Network for Facial Expression Recognition in the Wild

Combating Uncertainty and Class Imbalance in Facial Expression Recognition

A Dual-Direction Attention Mixed Feature Network for Facial Expression Recognition

Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition

Empirical Investigation of Multimodal Sensors in Novel Deep Facial Expression Recognition In-the-Wild

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

A Region Group Adaptive Attention Model for Subtle Expression Recognition

CF-DAN: Facial-expression recognition based on cross-fusion dual-attention network

MPCSAN: Multi-Head Parallel Channel-Spatial Attention Network for Facial Expression Recognition in the Wild

A Deep Structure for Facial Expression Recognition under Partial Occlusion

A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Multi-Attention Module for Dynamic Facial Emotion Recognition