Abstract:Driven by advancements in deep learning technologies, substantial progress has been achieved in the field of facial expression recognition over the past decade, while challenges remain brought about by occlusions, pose variations and subtle expression differences in unconstrained (wild) scenarios. Therefore, a novel multiscale feature extraction method is proposed in this paper, that leverages convolutional neural networks to simultaneously extract deep semantic features and shallow geometric features. Through the mechanism of channel-wise self-attention, prominent features are further extracted and compressed, preserving advantageous features for distinction and thereby reducing the impact of occlusions and pose variations on expression recognition. Meanwhile, inspired by the large cosine margin concept used in face recognition, a center cosine loss function is proposed to avoid the misclassification caused by the underlying interclass similarity and substantial intra-class feature variations in the task of expression recognition. This function is designed to enhance the classification performance of the network through making the distribution of samples within the same class more compact and that between different classes sparser. The proposed method is benchmarked against several advanced baseline models on three mainstream wild datasets and two datasets that present realistic occlusion and pose variation challenges. Accuracies of 89.63%, 61.82%, and 91.15% are achieved on RAF-DB, AffectNet and FERPlus, respectively, demonstrating the greater robustness and reliability of this method compared to the state-of-the-art alternatives in the real world.

A Novel Facial Expression Recognition Approach Based on MoSift

Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers.

Facial Expression Recognition Algorithm Based on Brightness Detecting and SVM

Adaptive Facial Expression Recognition Method Based on MBP and HMOG Feature

Identifying Facial Expression Using Adaptive Sub-Layer Compensation Based Feature Extraction

Facial Expression Using Adaptive Sublayer Compensation Based Feature Extraction

Facial Expression Recognition Using Geometric and Appearance Features

Spontaneous Expression Recognition Based on Visual Attention Mechanism and Co-salient Features.

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Facial Expression Recognition With Fusion Features Extracted From Salient Facial Areas

Facial expression classification using salient pattern driven integrated geometric and textual features

An Efficient Method For Facial Expression Recognition

Facial Expression Recognition Based on Spatio-Temporal Interest Points for Depth Sequences

Automatic facial expression recognition based on spatiotemporal descriptors

Facial Expression Recognition in the Wild Based on Multimodal Texture Features

Facial expression recognition based on multi-feature fusion by multi-kernel SVM

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Dynamic Facial Expression Recognition Using Boosted Component-Based Spatiotemporal Features and Multi-classifier Fusion

Expression recognition method based on sparse coefficients in subspace

3D Facial expression recognition using orthogonal tensor marginal fisher analysis on geometric maps