Abstract:Facial expression recognition (FER) in the wild is very challenging due to occlusion, posture, illumination, and other uncontrolled factors. Learning discriminant features for FER using Convolutional Neural Networks is a momentous task for the significant class imbalance, wrong labels, inter-class similarities, and intra-class variations. The traditional method utilizes the Cross entropy loss function to optimize the convolutional network to obtain discriminative features for classification. However, this loss function cannot effectively solve the above problems in practice and cannot contribute to obtaining highly discriminant facial features for further analysis. Center loss improves the learning efficiency by reducing the intra-class distance of similar expressions, while the improvement of inter-class similarity, class imbalance, and generalization is insufficient. In this paper, we propose a lightweight Effective Attention Feature Reconstruction loss (EAFR loss), which can further optimize the feature space and enhance the discriminability of expression. The loss model is composed of the Focal Smoothing loss (FS loss) and the Aggregation-Separation loss (AS loss). Firstly, the FS loss can improve the poor recognition performance caused by imbalanced classes and prevent paranoid knowledge learning behaviors. Meanwhile, AS loss further accurately condenses the intra-class expression features and expands the inter-class distance, which is achieved by using progressive stage max-pooling channel and position attention mechanism and lightweight asymmetric autoencoder model for feature reconstruction. Finally, the EAFR loss joins the above two loss functions to more comprehensively solve the above typical problems for FER in the wild. We validate the proposed loss function on three most commonly used large-scale wild expression datasets (RAF-DB, FERPlus, and AffectNet), and the results show that our model achieves superior performance to several state-of-the-art methods.

Improving Multi-Label Facial Expression Recognition with Consistent and Distinct Attentions

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

A Multi-Label Classification Approach for Facial Expression Recognition

Multi-branch Attention Consistency Network for Facial Expression Recognition

Facial expression recognition through multi-level features extraction and fusion

An Enhanced Facial Expression Recognition Method Based on Multi-task Learning

Multi-Head Attention Affinity Diversity Sharing Network for Facial Expression Recognition

Multi-level Spatial and Semantic Enhancement Network for Expression Recognition

Multi-Attention Module for Dynamic Facial Emotion Recognition

Evaluation and analysis of visual perception using attention-enhanced computation in multimedia affective computing

JADFER: Exploring Spatial-Contextual Interaction with Joint Attention Dropping for Facial Expression Recognition

Self-supervised Exclusive-Inclusive Interactive Learning for Multi-label Facial Expression Recognition in the Wild

Focusing on All Refined Attention Regions for Noisy Label Facial Expression Recognition

Attention-Rectified and Texture-Enhanced Cross-Attention Transformer Feature Fusion Network for Facial Expression Recognition

MPCSAN: Multi-Head Parallel Channel-Spatial Attention Network for Facial Expression Recognition in the Wild

TP-FER: an Effective Three-phase Noise-tolerant Recognizer for Facial Expression Recognition.

Multi-relations Aware Network for in-the-wild Facial Expression Recognition

Cross-Domain Facial Expression Recognition Through Reliable Global–Local Representation Learning and Dynamic Label Weighting

Facial Expression Recognition with Contrastive Learning and Uncertainty-Guided Relabeling

Effective Attention Feature Reconstruction Loss for Facial Expression Recognition in the Wild

Multi-task Facial Expression Recognition With Joint Gender Learning