Abstract:Facial expression recognition has received extensive attention in recent years due to its important applications in many fields. Most expression samples used in research are relatively easy to analyze emotions because they have explicit expressions with strong intensities. However, in situations such as video question and answer, business negotiation, polygraph detection in the security field, autism treatment and medical escort, emotions are expressed in suppressed manners with low intensive expression or subtle expressions, making it difficult to estimate emotions accurately. In these situations, how to effectively extract expression features from facial expression images is a critical problem that affects the accuracy of subtle expression recognition. To address this problem, we propose an end-to-end group adaptive attention model for subtle expression recognition. Cropping an image into several regions of interest (ROI) according to the correlations between facial skeleton and emotions, the proposed model analyses the relationship among regions of interest, and mutual relations between local regions and the holistic region. Using the region group adaptive attention mechanism, the model effectively trains the convolutional neural network to efficiently extract facial expressions representing features and increases the accuracy and robustness of the recognition, particularly in some subtle facial expression circumstances. To improve the ability of different regional features to discriminate expressions, a group adaptive loss function is introduced to verify and improve estimation accuracy. Extensive experiments are conducted on the existing public face datasets CK+, JAFFE, KDEF and the self-collected subtle expression dataset SFER. Results show that the proposed model achieves accuracies of 99.59%, 95.20%, and 93.47% with datasets CK+, JAFFE, and KDEF, respectively. The proposed model thus generally achieves better performance in facial expression recognition than other methods.

Pairwise dependency-based robust ensemble pruning for facial expression recognition

An ensemble pruning method considering classifiers' interaction based on information theory for facial expression recognition

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Graph-based dynamic ensemble pruning for facial expression recognition

An efficient semi-dynamic ensemble pruning method for facial expression recognition

CSLSEP: an ensemble pruning algorithm based on clustering soft label and sorting for facial expression recognition

RTCRelief-F: an effective clustering and ordering-based ensemble pruning algorithm for facial expression recognition

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Editorial for Pattern Recognition Letters Special Issue on Face-Based Emotion Understanding

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

D2SP: Dynamic Dual-Stage Purification Framework for Dual Noise Mitigation in Vision-based Affective Recognition

A Region Group Adaptive Attention Model for Subtle Expression Recognition

Face Recognition Using Linear Representation Ensembles.

Face Recognition using Optimal Representation Ensemble

Multi Loss-based Feature Fusion and Top Two Voting Ensemble Decision Strategy for Facial Expression Recognition in the Wild

Adaptively Learning Facial Expression Representation via C-F Labels and Distillation

A Novel Attention Residual Network Expression Recognition Method

Two-pathway attention network for real-time facial expression recognition

Combating Uncertainty and Class Imbalance in Facial Expression Recognition

Facial Expression Recognition Method Combined with Attention Mechanism