Abstract:Existing facial expression recognition methods have some drawbacks. For example, it becomes difficult for network learning on cross-dataset facial expressions, multi-region learning on an image did not extract the overall image information, and a frequency multiplication network did not take into account the inter-class and intra-class features in image classification. In order to deal with the above problems, in our current research, we raise a symmetric mode to extract the inter-class features and intra-class diversity features, and then propose a triple-structure network model based upon MobileNet V1, which is trained via a new multi-branch loss function. Such a proposed network consists of triple structures, viz., a global branch network, an attention mechanism branch network, and a diversified feature learning branch network. To begin with, the global branch network is used to extract the global features of the facial expression images. Furthermore, an attention mechanism branch network concentrates to extract inter-class features. In addition, the diversified feature learning branch network is utilized to extract intra-class diverse features. The network training is performed by using multiple loss functions to decrease intra-class differences and inter-class similarities. Finally, through ablation experiments and visualization, the intrinsic mechanism of our triple-structure network model is proved to be very reasonable. Experiments on the KDEF, MMI, and CK+ datasets show that the accuracy of facial expression recognition using the proposed model is 1.224%, 13.051%, and 3.085% higher than that using MC-loss (VGG16), respectively. In addition, related comparison tests and analyses proved that our raised triple-structure network model reaches better performance than dozens of state-of-the-art methods.

Multi-stage and multi-branch network with similar expressions label distribution learning for facial expression recognition

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Blended Emotion in-the-Wild: Multi-label Facial Expression Recognition Using Crowdsourced Annotations and Deep Locality Feature Learning

Multi-Head Attention Affinity Diversity Sharing Network for Facial Expression Recognition

Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP

Using Attention Lsgb Network for Facial Expression Recognition

Robust Lightweight Facial Expression Recognition Network with Label Distribution Training

A Triple-Structure Network Model Based Upon MobileNet V1 and Multi-Loss Function for Facial Expression Recognition

Attention mechanism-based CNN for facial expression recognition

Facial Expression Recognition with Contrastive Learning and Uncertainty-Guided Relabeling

A multi-scale multi-attention network for dynamic facial expression recognition

Adaptively Learning Facial Expression Representation via C-F Labels and Distillation

A facial expression recognition network based on attention double branch enhanced fusion

Dynamic Multi-Channel Metric Network for Joint Pose-Aware and Identity-Invariant Facial Expression Recognition

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

Hybrid Attention-Aware Learning Network for Facial Expression Recognition in the Wild

Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition

A Cascade Attention Based Facial Expression Recognition Network by Fusing Multi-Scale Spatio-Temporal Features

Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild

Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition