Abstract:With the development of deep learning technology, the performance of facial expression recognition (FER) has been significantly improved. The current main challenge comes from the confusion of facial expressions caused by the highly nonlinear changes of facial expressions. However, the existing FER methods based on Convolutional Neural Networks (CNN) often ignore the underlying relationship between expressions which is crucial to meliorate the performance of recognition for confusable expressions. And the methods based on Graph Convolutional Networks (GCN) can capture the relationship between vertices, but the aggregation degree of subgraphs generated by these methods is low. They are easy to include unconfident neighbors, which increases the learning difficulty of the network. To solve the above problems, this paper proposes a method to recognize facial expressions on the high aggregation subgraphs (HASs) by combing the advantages of CNN extracting features and GCN modeling complex graph patterns. Specifically, we formulate FER as a vertex prediction problem. Considering the importance of high-order neighbors and higher efficiency, we utilize vertex confidence to find high-order neighbors. Then we construct the HASs based on the top embedding features of these high-order neighbors. And we utilize the GCN to perform reasoning and infer the class of vertices for HASs without a large number of overlapping subgraphs. Our method captures the underlying relationship between expressions on the HASs and improves the accuracy and efficiency of FER. Experimental results on both the in-the-lab datasets and the in-the-wild datasets show that our method achieves higher recognition accuracy than several state-of-the-art methods. This highlights the benefit of the underlying relationship between expressions for FER.

Two-stream Gabor-AGraph Convolutional Networks for Facial Expression Recognition

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Two-stream Global-Guided Attention Network for Facial Expression Recognition

SG-DSN: A Semantic Graph-based Dual-Stream Network for facial expression recognition

Video-based Facial Expression Recognition Using Graph Convolutional Networks.

Two-pathway attention network for real-time facial expression recognition

Fast and Efficient Facial Expression Recognition Using a Gabor Convolutional Network

Robust facial expression recognition with global-local joint representation learning

GCANet: Geometry Cues-aware Facial Expression Recognition based on Graph Convolutional Networks

Facial Attention based Convolutional Neural Network for 2D+3D Facial Expression Recognition

Cs-gresnet: a simple and highly efficient network for facial expression recognition

Two-stream Inter-Class Variation Enhancement Network for Facial Expression Recognition

Learning Associative Representation for Facial Expression Recognition.

Geometric-Convolutional Feature Fusion Based On Learning Propagation For Facial Expression Recognition

Geometry-Aware Facial Expression Recognition Via Attentive Graph Convolutional Networks

Facial Expression Recognition on the High Aggregation Subgraphs

GCF: Graph Convolutional Networks for Facial Expression Recognition

FG-AGR: Fine-Grained Associative Graph Representation for Facial Expression Recognition in the Wild

Dynamic Facial Expression Recognition Based on Two-Stream-CNN with LBP-TOP

Facial Expression Recognition Via Deep Action Units Graph Network Based on Psychological Mechanism

A Dual-Direction Attention Mixed Feature Network for Facial Expression Recognition