Abstract:Facial expression recognition (FER) in the wild is very challenging due to occlusion, posture, illumination, and other uncontrolled factors. Learning discriminant features for FER using Convolutional Neural Networks is a momentous task for the significant class imbalance, wrong labels, inter-class similarities, and intra-class variations. The traditional method utilizes the Cross entropy loss function to optimize the convolutional network to obtain discriminative features for classification. However, this loss function cannot effectively solve the above problems in practice and cannot contribute to obtaining highly discriminant facial features for further analysis. Center loss improves the learning efficiency by reducing the intra-class distance of similar expressions, while the improvement of inter-class similarity, class imbalance, and generalization is insufficient. In this paper, we propose a lightweight Effective Attention Feature Reconstruction loss (EAFR loss), which can further optimize the feature space and enhance the discriminability of expression. The loss model is composed of the Focal Smoothing loss (FS loss) and the Aggregation-Separation loss (AS loss). Firstly, the FS loss can improve the poor recognition performance caused by imbalanced classes and prevent paranoid knowledge learning behaviors. Meanwhile, AS loss further accurately condenses the intra-class expression features and expands the inter-class distance, which is achieved by using progressive stage max-pooling channel and position attention mechanism and lightweight asymmetric autoencoder model for feature reconstruction. Finally, the EAFR loss joins the above two loss functions to more comprehensively solve the above typical problems for FER in the wild. We validate the proposed loss function on three most commonly used large-scale wild expression datasets (RAF-DB, FERPlus, and AffectNet), and the results show that our model achieves superior performance to several state-of-the-art methods.

Focusing on All Refined Attention Regions for Noisy Label Facial Expression Recognition

Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Improving Multi-Label Facial Expression Recognition with Consistent and Distinct Attentions

Using Attention Lsgb Network for Facial Expression Recognition

Adaptively Enhancing Facial Expression Crucial Regions via Local Non-Local Joint Network

Adaptively Enhancing Facial Expression Crucial Regions Via a Local Non-local Joint Network

TP-FER: an Effective Three-phase Noise-tolerant Recognizer for Facial Expression Recognition.

Facial Attention based Convolutional Neural Network for 2D+3D Facial Expression Recognition

LA-Net: Landmark-Aware Learning for Reliable Facial Expression Recognition under Label Noise

Toward Facial Expression Recognition in the Wild Via Noise-Tolerant Network.

MPCSAN: Multi-Head Parallel Channel-Spatial Attention Network for Facial Expression Recognition in the Wild

Effective Attention Feature Reconstruction Loss for Facial Expression Recognition in the Wild

Noisy label facial expression recognition via face-specific label distribution learning

Local and Correlation Attention Learning for Subtle Facial Expression Recognition

Real-Time Facial Expression Recognition Based on Attention Mechanism

Multi-Attention Module for Dynamic Facial Emotion Recognition

A Gradual Self Distillation Network with Adaptive Channel Attention for Facial Expression Recognition

Two-pathway attention network for real-time facial expression recognition

Hybrid Attention-Aware Learning Network for Facial Expression Recognition in the Wild

Facial Expression Recognition Network with Slow Convolution and Zero-parameter Attention Mechanism