Abstract:Driven by advancements in deep learning technologies, substantial progress has been achieved in the field of facial expression recognition over the past decade, while challenges remain brought about by occlusions, pose variations and subtle expression differences in unconstrained (wild) scenarios. Therefore, a novel multiscale feature extraction method is proposed in this paper, that leverages convolutional neural networks to simultaneously extract deep semantic features and shallow geometric features. Through the mechanism of channel-wise self-attention, prominent features are further extracted and compressed, preserving advantageous features for distinction and thereby reducing the impact of occlusions and pose variations on expression recognition. Meanwhile, inspired by the large cosine margin concept used in face recognition, a center cosine loss function is proposed to avoid the misclassification caused by the underlying interclass similarity and substantial intra-class feature variations in the task of expression recognition. This function is designed to enhance the classification performance of the network through making the distribution of samples within the same class more compact and that between different classes sparser. The proposed method is benchmarked against several advanced baseline models on three mainstream wild datasets and two datasets that present realistic occlusion and pose variation challenges. Accuracies of 89.63%, 61.82%, and 91.15% are achieved on RAF-DB, AffectNet and FERPlus, respectively, demonstrating the greater robustness and reliability of this method compared to the state-of-the-art alternatives in the real world.

Facial Expression Recognition Based on Ensemble of Mulitple CNNs.

Facial Expression Recognition Based on Ensemble Convolutional Neural Network

Improving Ensemble Learning Performance With Complementary Neural Networks For Facial Expression Recognition

Facial Expression Classification Based on Ensemble Convolutional Neural Network

Ensemble of Deep Neural Networks with Probability-Based Fusion for Facial Expression Recognition.

Facial Expression Recognition Using Optimized Active Regions

Facial expression recognition with multi-scale convolution neural network

Multi-modal Facial Expression Feature Based on Deep-Neural Networks

Recognition of Facial Expression Based on CNN-CBP Features

Facial Expression Recognition Using Hierarchical Features with Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

Attention mechanism-based CNN for facial expression recognition

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

Convolutional Neural Network Based Expression Classification with Face Alignment

A Facial Expression Recognition Method Based on a Multibranch Cross-Connection Convolutional Neural Network

Facial Expression Recognition Based on Local Feature Fusion of Convolutional Neural Network

Video facial emotion recognition based on local enhanced motion history image and CNN-CTSLSTM networks

Facial Expression Recognition Based on Gabor Wavelet Transform and 2-Channel CNN

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

An Ensemble Convolutional Echo State Networks for Facial Expression Recognition.

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure