Abstract:<p class="a-plus-plus">Many scholars are committed to using deep learning methods to study facial expression recognition (FER). In recent years, FER has gradually been confined to psychology research in the early days to now involves knowledge of many disciplines such as physiology, psychology, cognition and medicine. With the extreme achievement of computer version techniques, various convolutional neural network structures were developed for real-time and accurate FER. There are two main problems in the existing convolutional neural network for handling FER problems: insufficient training data caused over-fitting and expression-unrelated intra-class differences. In this paper, we propose a two-pathway attention network to solve these two problems better. We suppress the intra-class differences efficiently by extracting facial regions based on facial muscle movements driven by facial expressions. We prevent deep networks from insufficient training data by extensively extracting global structures and local facial regions as the training dataset to feed a two-pathway ensemble model. Further more, we weight the whole feature maps from the global image and local regions by introducing an attention mechanism module to reweighs each part according to its contribution to FER. We adopt real-time facial region extraction and multi-layer feature data compression to ensure the real-time performance of the algorithm and reduce the amount of parameters in ensemble model. Experiments on public datasets suggest that our method certifies its effectiveness, reaches human-level performance, and outperforms current state-of-the-art methods with 92.8% on CK+ and 87.0% on FERPLUS.</p>

A Cascaded Spatiotemporal Attention Network for Dynamic Facial Expression Recognition

Attend to Where and When: Cascaded Attention Network for Facial Expression Recognition

LSTPNet: Long short-term perception network for dynamic facial expression recognition in the wild

A Cascade Attention Based Facial Expression Recognition Network by Fusing Multi-Scale Spatio-Temporal Features

MSSTNet: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition

Enhanced Spatial-Temporal Learning Network for Dynamic Facial Expression Recognition

A multi-scale multi-attention network for dynamic facial expression recognition

Multi-Attention Module for Dynamic Facial Emotion Recognition

SAANet: Siamese Action-Units Attention Network for Improving Dynamic Facial Expression Recognition

A Joint Local Spatial and Global Temporal CNN-Transformer for Dynamic Facial Expression Recognition

Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wild

A Dual-Direction Attention Mixed Feature Network for Facial Expression Recognition

NSNP-DFER: A Nonlinear Spiking Neural P Network for Dynamic Facial Expression Recognition

CFAN-SDA: Coarse-fine Aware Network with Static-Dynamic Adaptation for Facial Expression Recognition in Videos

Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Dual-STI: Dual-path spatial-temporal interaction learning for dynamic facial expression recognition

Deep Spatial-Temporal Feature Fusion for Facial Expression Recognition in Static Images

Two-pathway attention network for real-time facial expression recognition

Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognition

Spatiotemporal and Frequential Cascaded Attention Networks for Speech Emotion Recognition.

GAT-Net: A Network Using Grid Attention and Transformer for Dynamic Facial Expression Recognition