Abstract:Facial expression recognition has received extensive attention in recent years due to its important applications in many fields. Most expression samples used in research are relatively easy to analyze emotions because they have explicit expressions with strong intensities. However, in situations such as video question and answer, business negotiation, polygraph detection in the security field, autism treatment and medical escort, emotions are expressed in suppressed manners with low intensive expression or subtle expressions, making it difficult to estimate emotions accurately. In these situations, how to effectively extract expression features from facial expression images is a critical problem that affects the accuracy of subtle expression recognition. To address this problem, we propose an end-to-end group adaptive attention model for subtle expression recognition. Cropping an image into several regions of interest (ROI) according to the correlations between facial skeleton and emotions, the proposed model analyses the relationship among regions of interest, and mutual relations between local regions and the holistic region. Using the region group adaptive attention mechanism, the model effectively trains the convolutional neural network to efficiently extract facial expressions representing features and increases the accuracy and robustness of the recognition, particularly in some subtle facial expression circumstances. To improve the ability of different regional features to discriminate expressions, a group adaptive loss function is introduced to verify and improve estimation accuracy. Extensive experiments are conducted on the existing public face datasets CK+, JAFFE, KDEF and the self-collected subtle expression dataset SFER. Results show that the proposed model achieves accuracies of 99.59%, 95.20%, and 93.47% with datasets CK+, JAFFE, and KDEF, respectively. The proposed model thus generally achieves better performance in facial expression recognition than other methods.

Expression recognition method based on sparse coefficients in subspace

Two-stage nonnegative sparse representation for large-scale face recognition.

Facial Expression Recognition Based on G-2DPCA Feature and Sparse Representation Classification

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Subtle expression recognition-a comprehensive approach

Expression Recognition Based on Variant Sampling Method and Gabor Features

Facial Action Unit Recognition with Sparse Representation.

A Region Group Adaptive Attention Model for Subtle Expression Recognition

Face Recognition Based on Multi-Wavelet and Sparse Representation.

Latent sparse transfer subspace learning for cross-corpus facial expression recognition

Sparse Representation for Face Recognition Based on Constraint Sampling and Face Alignment

Feature Selection in Face Recognition: A Sparse Representation Perspective

Micro-Expression Recognition Based on 2d Gabor Filter and Sparse Representation

Robust Face Recognition Via Sparse Representation

Sparse Spatiotemporal Descriptor for Micro-Expression Recognition Using Enhanced Local Cube Binary Pattern

Robust Face Recognition via Adaptive Sparse Representation

Facial expression recognition and generation using sparse autoencoder

A Comprehensive Empirical Study on Linear Subspace Methods for Facial Expression Analysis

Facial Expression Recognition Using Multi-Svm with Eigenexpress

Facial Expression Recognition Via Weighted Group Sparsity.