Abstract:Driven by advancements in deep learning technologies, substantial progress has been achieved in the field of facial expression recognition over the past decade, while challenges remain brought about by occlusions, pose variations and subtle expression differences in unconstrained (wild) scenarios. Therefore, a novel multiscale feature extraction method is proposed in this paper, that leverages convolutional neural networks to simultaneously extract deep semantic features and shallow geometric features. Through the mechanism of channel-wise self-attention, prominent features are further extracted and compressed, preserving advantageous features for distinction and thereby reducing the impact of occlusions and pose variations on expression recognition. Meanwhile, inspired by the large cosine margin concept used in face recognition, a center cosine loss function is proposed to avoid the misclassification caused by the underlying interclass similarity and substantial intra-class feature variations in the task of expression recognition. This function is designed to enhance the classification performance of the network through making the distribution of samples within the same class more compact and that between different classes sparser. The proposed method is benchmarked against several advanced baseline models on three mainstream wild datasets and two datasets that present realistic occlusion and pose variation challenges. Accuracies of 89.63%, 61.82%, and 91.15% are achieved on RAF-DB, AffectNet and FERPlus, respectively, demonstrating the greater robustness and reliability of this method compared to the state-of-the-art alternatives in the real world.

Research of Facial Features Extraction Technology Based on Trace Transform

A new facial feature based on the fusion of texture and shape characteristics

Edge Extraction of Face Images for Expression Analysis

Facial Expression Recognition System Based on Multiple Feature Integration

Novel Facial Features Segmentation Algorithm

A Novel Facial Features Extraction Algorithm Using Gabor Wavelets

Facial Feature Extraction Based on Facial Texture Distribution and Deformable Template

New Research Advances in Facial Expression Recognition

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Real-Time facial expression recognition system based on HMM and feature point localization

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Novel algebraic feature extraction method and facial recognition

A Novel Facial Feature Localization and Extraction Method

Enhanced Dual-Level Representations for Facial Expression Recognition

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

Improving the Facial Expression Recognition and Its Interpretability Via Generating Expression Pattern-map

Studies Advanced in Development and Application of Facial Expression Recognition

A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition

Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model

A Survey on Facial Features Localization