Abstract:Driven by advancements in deep learning technologies, substantial progress has been achieved in the field of facial expression recognition over the past decade, while challenges remain brought about by occlusions, pose variations and subtle expression differences in unconstrained (wild) scenarios. Therefore, a novel multiscale feature extraction method is proposed in this paper, that leverages convolutional neural networks to simultaneously extract deep semantic features and shallow geometric features. Through the mechanism of channel-wise self-attention, prominent features are further extracted and compressed, preserving advantageous features for distinction and thereby reducing the impact of occlusions and pose variations on expression recognition. Meanwhile, inspired by the large cosine margin concept used in face recognition, a center cosine loss function is proposed to avoid the misclassification caused by the underlying interclass similarity and substantial intra-class feature variations in the task of expression recognition. This function is designed to enhance the classification performance of the network through making the distribution of samples within the same class more compact and that between different classes sparser. The proposed method is benchmarked against several advanced baseline models on three mainstream wild datasets and two datasets that present realistic occlusion and pose variation challenges. Accuracies of 89.63%, 61.82%, and 91.15% are achieved on RAF-DB, AffectNet and FERPlus, respectively, demonstrating the greater robustness and reliability of this method compared to the state-of-the-art alternatives in the real world.

Multi-scale Feature Relation Modeling for Facial Expression Restoration

Joint Face Completion and Super-Resolution Using Multi-Scale Feature Relation Learning

Facial Expression Restoration Based on Improved Graph Convolutional Networks

Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior

Face Inpainting With Dynamic Structural Information Of Facial Action Units

A New Deep Learning Method for Multi-label Facial Expression Recognition Based on Local Constraint Features

Feature Super-Resolution Based Facial Expression Recognition for Multi-Scale Low-Resolution Images

A Facial Expression Synthesis Method Based on Generative Adversarial Network.

Feature-Guided Blind Face Restoration with GAN Prior

Overcoming False Illusions in Real-World Face Restoration with Multi-Modal Guided Diffusion Model

Multi-relations Aware Network for in-the-wild Facial Expression Recognition

Joint Face Image Restoration and Frontalization for Recognition

Multi-scale Generative Adversarial Learning for Facial Attribute Transfer.

Facial Image Restoration Based on Adversarial Training and Convolutional Neural Network

HiFaceGAN: Face Renovation Via Collaborative Suppression and Replenishment

HPG-GAN: High-Quality Prior-Guided Blind Face Restoration Generative Adversarial Network

CFR-GAN: A Generative Model for Craniofacial Reconstruction

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Image Super-Resolution Reconstruction Based on Multi-Scale Dual-Attention

Frontal Face Reconstruction Based on Detail Identification, Variable Scale Self-Attention and Flexible Skip Connection