Abstract:<p class="a-plus-plus">Many scholars are committed to using deep learning methods to study facial expression recognition (FER). In recent years, FER has gradually been confined to psychology research in the early days to now involves knowledge of many disciplines such as physiology, psychology, cognition and medicine. With the extreme achievement of computer version techniques, various convolutional neural network structures were developed for real-time and accurate FER. There are two main problems in the existing convolutional neural network for handling FER problems: insufficient training data caused over-fitting and expression-unrelated intra-class differences. In this paper, we propose a two-pathway attention network to solve these two problems better. We suppress the intra-class differences efficiently by extracting facial regions based on facial muscle movements driven by facial expressions. We prevent deep networks from insufficient training data by extensively extracting global structures and local facial regions as the training dataset to feed a two-pathway ensemble model. Further more, we weight the whole feature maps from the global image and local regions by introducing an attention mechanism module to reweighs each part according to its contribution to FER. We adopt real-time facial region extraction and multi-layer feature data compression to ensure the real-time performance of the algorithm and reduce the amount of parameters in ensemble model. Experiments on public datasets suggest that our method certifies its effectiveness, reaches human-level performance, and outperforms current state-of-the-art methods with 92.8% on CK+ and 87.0% on FERPLUS.</p>

Leveraging 3D Blendshape for Facial Expression Recognition Using CNN

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

3D Facial Expression Recognition Using Deep Feature Fusion CNN

The Facial Expression Recognition Method Based on Image Fusion and CNN

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

Discriminative Attention-based Convolutional Neural Network for 3D Facial Expression Recognition.

Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network

Facial Attention based Convolutional Neural Network for 2D+3D Facial Expression Recognition

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

An Improved SimAM Based CNN for Facial Expression Recognition

Facial Expression Recognition Using Deep Neural Network

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

An Efficient Channel Attention CNN for Facial Expression Recognition

Multi-level Spatial and Semantic Enhancement Network for Expression Recognition

Two-pathway attention network for real-time facial expression recognition

Facial Expression Recognition Using Hierarchical Features with Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

Facial expression recognition through multi-level features extraction and fusion

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

Facial Expression Recognition Considering Individual Differences in Facial Structure and Texture.