Abstract:<p class="a-plus-plus">Many scholars are committed to using deep learning methods to study facial expression recognition (FER). In recent years, FER has gradually been confined to psychology research in the early days to now involves knowledge of many disciplines such as physiology, psychology, cognition and medicine. With the extreme achievement of computer version techniques, various convolutional neural network structures were developed for real-time and accurate FER. There are two main problems in the existing convolutional neural network for handling FER problems: insufficient training data caused over-fitting and expression-unrelated intra-class differences. In this paper, we propose a two-pathway attention network to solve these two problems better. We suppress the intra-class differences efficiently by extracting facial regions based on facial muscle movements driven by facial expressions. We prevent deep networks from insufficient training data by extensively extracting global structures and local facial regions as the training dataset to feed a two-pathway ensemble model. Further more, we weight the whole feature maps from the global image and local regions by introducing an attention mechanism module to reweighs each part according to its contribution to FER. We adopt real-time facial region extraction and multi-layer feature data compression to ensure the real-time performance of the algorithm and reduce the amount of parameters in ensemble model. Experiments on public datasets suggest that our method certifies its effectiveness, reaches human-level performance, and outperforms current state-of-the-art methods with 92.8% on CK+ and 87.0% on FERPLUS.</p>

F-DR Net:Face Detection and Recognition in One Net

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

End-to-End Spatial Transform Face Detection and Recognition

Feature Agglomeration Networks for Single Stage Face Detection

UFaceNet: Research on Multi-Task Face Recognition Algorithm Based on CNN.

Split-Net: Improving Face Recognition in One Forwarding Operation

End-To-End Face Detection and Recognition

Uniface: A Unified Network for Face Detection and Recognition

Face Detection With End-To-End Integration Of A Convnet And A 3d Model

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Multitask learning and CNN for application of face recognition.

An Efficient Method of Face and Keypoint Detection Based on Shared Network

Multi-Net Fusion: Exploring a Brain-Inspired Neural Network Model for Facial Expression Recognition

Multi-task Feature-Aligned Head in One-Stage Object Detection

Two-pathway attention network for real-time facial expression recognition

Face-Inception-Net for Recognition

Learning an attention-aware parallel sharing network for facial attribute recognition

DualNet: Learn Complementary Features for Image Recognition

TRFH: Towards Real-Time Face Detection and Head Pose Estimation.

Multi-Task Network and Optimization for Face Detection and Attribute Analysis

CFNet: Facial Expression Recognition Via Constraint Fusion under Multi-Task Joint Learning Network.