Abstract:Driven by advancements in deep learning technologies, substantial progress has been achieved in the field of facial expression recognition over the past decade, while challenges remain brought about by occlusions, pose variations and subtle expression differences in unconstrained (wild) scenarios. Therefore, a novel multiscale feature extraction method is proposed in this paper, that leverages convolutional neural networks to simultaneously extract deep semantic features and shallow geometric features. Through the mechanism of channel-wise self-attention, prominent features are further extracted and compressed, preserving advantageous features for distinction and thereby reducing the impact of occlusions and pose variations on expression recognition. Meanwhile, inspired by the large cosine margin concept used in face recognition, a center cosine loss function is proposed to avoid the misclassification caused by the underlying interclass similarity and substantial intra-class feature variations in the task of expression recognition. This function is designed to enhance the classification performance of the network through making the distribution of samples within the same class more compact and that between different classes sparser. The proposed method is benchmarked against several advanced baseline models on three mainstream wild datasets and two datasets that present realistic occlusion and pose variation challenges. Accuracies of 89.63%, 61.82%, and 91.15% are achieved on RAF-DB, AffectNet and FERPlus, respectively, demonstrating the greater robustness and reliability of this method compared to the state-of-the-art alternatives in the real world.

Multilevel and Multiscale Feature Aggregation in Deep Networks for Facial Constitution Classification

Transfer Learning with Deep Convolutional Neural Network for Constitution Classification with Face Image

Deep Convolutional Neural Networks for Classifying Body Constitution Based on Face Image

Classifying Chinese Medicine Constitution Using Multimodal Deep-Learning Model

Multi-label Recognition of Facial Body Constitution Via MLP-like Deep Networks with Non-Equilibrium Weight Loss.

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Deep Convolutional Neural Networks for Classifying Body Constitution

Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms

An End-to-End Traditional Chinese Medicine Constitution Assessment System Based on Multimodal Clinical Feature Representation and Fusion

Multi-task Learning of Cascaded CNN for Facial Attribute Classification.

Grouped Multi-Task CNN for Facial Attribute Recognition

TCMINet: Face Parsing for Traditional Chinese Medicine Inspection via a Hybrid Neural Network With Context Aggregation

Deep Multi-task Multi-label CNN for Effective Facial Attribute Classification

Facial Emotion Recognition Based on Auxiliary Classifiers and SENet Module

Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network

Facial Expression Recognition Using Hierarchical Features with Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

A Deep Convolutional Neural Network-Based Framework for Automatic Fetal Facial Standard Plane Recognition

Multi-Scale Aggregation Network for Direct Face Alignment

Facial Sentiment Classification Based on Resnet-18 Model

Multiclass Classification and Recognition Method for A Chinese Human Face

A discriminative multiscale feature extraction network for facial expression recognition in the wild