Abstract:Facial expression recognition (FER) using a deep convolutional neural network (DCNN) is important and challenging. Although a substantial effort is made to increase FER accuracy through DCNN, previous studies are still not sufficiently generalizable for real-world applications. Traditional FER studies are mainly limited to controlled lab-posed frontal facial images, which lack the challenges of motion blur, head poses, occlusions, face deformations and lighting under uncontrolled conditions. In this work, we proposed a SqueezExpNet architecture that can take advantage of local and global facial information for a highly accurate FER system that can handle environmental variations. Our network was divided into two stages: a geometrical attention stage that possesses a SqueezeNet-like architecture to obtain local highlight information and a spatial texture stage comprising several squeezed and expanded layers to exploit high-level global features. In particular, we created a weighted mask of 3D face landmarks and used element-wise multiplication with a spatial feature in the first stage to draw attention to important local facial regions. Next, we input the face spatial image and its augmentations into the second stage of the network. Finally, like a classifier, a recurrent neural network was designed to collaborate the highlighted information from dual stages rather than simply using the SoftMax function, thereby aiding in overcoming the uncertainties. Experiments covering basic and compound FER tasks were performed using the three leading facial expression datasets. Our strategy outperformed the existing DCNN methods and achieved state-of-the-art results. The developed architecture, adopted research methodology and reported findings may find potential applications of real-time FER in surveillance, health and feedback systems.

Facial Expression Recognition with Squeeze-and-Excitation Network

Squeeze Excitation Densely Connected Residual Convolutional Networks for Specific Emitter Identification Based on Measured Signals

SqueezExpNet: Dual-stage convolutional neural network for accurate facial expression recognition with attention mechanism

Facial Expression Recognition Method Combined with Attention Mechanism

Attention mechanism-based CNN for facial expression recognition

An Efficient Channel Attention CNN for Facial Expression Recognition

Facial Emotion Recognition Based on Sobel-Resnet

Facial Emotion Recognition Based on Auxiliary Classifiers and SENet Module

Emotion Recognition with Facial Attention and Objective Activation Functions

A Video Sequence Face Expression Recognition Method Based on Squeeze-and-Excitation and 3DPCA Network

A Dual-Direction Attention Mixed Feature Network for Facial Expression Recognition

A facial expression recognition network based on attention double branch enhanced fusion

An Improved SimAM Based CNN for Facial Expression Recognition

Patch Attention Network for Video Facial Expression Recognition.

SAANet: Siamese Action-Units Attention Network for Improving Dynamic Facial Expression Recognition

Two-pathway attention network for real-time facial expression recognition

Light Attention Embedding for Facial Expression Recognition

A Novel Attention Residual Network Expression Recognition Method

Video-based Facial Expression Recognition Using Graph Convolutional Networks.

IVSA: Facial Expression Recognition Method with Salient Attention

Facial Expression Recognition Network with Slow Convolution and Zero-parameter Attention Mechanism