Abstract:Existing facial expression recognition methods have some drawbacks. For example, it becomes difficult for network learning on cross-dataset facial expressions, multi-region learning on an image did not extract the overall image information, and a frequency multiplication network did not take into account the inter-class and intra-class features in image classification. In order to deal with the above problems, in our current research, we raise a symmetric mode to extract the inter-class features and intra-class diversity features, and then propose a triple-structure network model based upon MobileNet V1, which is trained via a new multi-branch loss function. Such a proposed network consists of triple structures, viz., a global branch network, an attention mechanism branch network, and a diversified feature learning branch network. To begin with, the global branch network is used to extract the global features of the facial expression images. Furthermore, an attention mechanism branch network concentrates to extract inter-class features. In addition, the diversified feature learning branch network is utilized to extract intra-class diverse features. The network training is performed by using multiple loss functions to decrease intra-class differences and inter-class similarities. Finally, through ablation experiments and visualization, the intrinsic mechanism of our triple-structure network model is proved to be very reasonable. Experiments on the KDEF, MMI, and CK+ datasets show that the accuracy of facial expression recognition using the proposed model is 1.224%, 13.051%, and 3.085% higher than that using MC-loss (VGG16), respectively. In addition, related comparison tests and analyses proved that our raised triple-structure network model reaches better performance than dozens of state-of-the-art methods.

Multi-branch Attention Consistency Network for Facial Expression Recognition

Multi-stage and multi-branch network with similar expressions label distribution learning for facial expression recognition

Multi-Head Attention Affinity Diversity Sharing Network for Facial Expression Recognition

Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition

Multi‐Task and Attention Collaborative Network for Facial Emotion Recognition

TAMNet: Two Attention Modules-Based Network on Facial Expression Recognition under Uncertainty

Hybrid Attention-Aware Learning Network for Facial Expression Recognition in the Wild

Uncertain Facial Expression Recognition via Multi-Task Assisted Correction

A facial expression recognition network based on attention double branch enhanced fusion

Attention mechanism-based CNN for facial expression recognition

Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms

Using Attention Lsgb Network for Facial Expression Recognition

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

BPMB: BayesCNNs with perturbed multi-branch structure for robust facial expression recognition

Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Adaptive multilayer perceptual attention network for facial expression recognition

Multi-Attention Module for Dynamic Facial Emotion Recognition

A Lightweight Attention-based Deep Network via Multi-Scale Feature Fusion for Multi-View Facial Expression Recognition

Co-attentive multi-task convolutional neural network for facial expression recognition

A Triple-Structure Network Model Based Upon MobileNet V1 and Multi-Loss Function for Facial Expression Recognition