Abstract:Facial expression recognition has received extensive attention in recent years due to its important applications in many fields. Most expression samples used in research are relatively easy to analyze emotions because they have explicit expressions with strong intensities. However, in situations such as video question and answer, business negotiation, polygraph detection in the security field, autism treatment and medical escort, emotions are expressed in suppressed manners with low intensive expression or subtle expressions, making it difficult to estimate emotions accurately. In these situations, how to effectively extract expression features from facial expression images is a critical problem that affects the accuracy of subtle expression recognition. To address this problem, we propose an end-to-end group adaptive attention model for subtle expression recognition. Cropping an image into several regions of interest (ROI) according to the correlations between facial skeleton and emotions, the proposed model analyses the relationship among regions of interest, and mutual relations between local regions and the holistic region. Using the region group adaptive attention mechanism, the model effectively trains the convolutional neural network to efficiently extract facial expressions representing features and increases the accuracy and robustness of the recognition, particularly in some subtle facial expression circumstances. To improve the ability of different regional features to discriminate expressions, a group adaptive loss function is introduced to verify and improve estimation accuracy. Extensive experiments are conducted on the existing public face datasets CK+, JAFFE, KDEF and the self-collected subtle expression dataset SFER. Results show that the proposed model achieves accuracies of 99.59%, 95.20%, and 93.47% with datasets CK+, JAFFE, and KDEF, respectively. The proposed model thus generally achieves better performance in facial expression recognition than other methods.

A Spatio-Temporal Integrated Model Based on Local and Global Features for Video Expression Recognition

Video Expression Recognition Method Based on Facial Motion Unit and Temporal Attention

Video facial emotion recognition based on local enhanced motion history image and CNN-CTSLSTM networks

Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks

Mixing Global and Local Features for Long-Tailed Expression Recognition

Facial Micro-Expression Recognition Based on Multi-Scale Temporal and Spatial Features

Facial Expression Recognition Based on the Fusion of Spatio-temporal Features in Video Sequences

A Visual Self-Attention Network for Facial Expression Recognition.

A Joint Local Spatial and Global Temporal CNN-Transformer for Dynamic Facial Expression Recognition

Facial Micro-expression Recognition Using Enhanced Temporal Feature-Wise Model

Enhanced Spatial-Temporal Learning Network for Dynamic Facial Expression Recognition

Facial Micro-Expression Recognition Based on Deep Local-Holistic Network

Learning facial expression and body gesture visual information for video emotion recognition

Multi-attention Based Deep Neural Network with Hybrid Features for Dynamic Sequential Facial Expression Recognition

Facial Micro-Expression Recognition Enhanced by Score Fusion and a Hybrid Model from Convolutional LSTM and Vision Transformer

A Region Group Adaptive Attention Model for Subtle Expression Recognition

Facial Expression Recognition Via Coarse-Grained and Fine-Grained Feature Representation

Learning Expression Features via Deep Residual Attention Networks for Facial Expression Recognition From Video Sequences

JGULF: Joint global and unilateral local feature network for micro-expression recognition

Video Emotion Recognition Using Local Enhanced Motion History Image and CNN-RNN Networks.