Abstract:The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial action unit (AU) detection primarily focus on modelling various AU relations between corresponding local muscle areas or mining global attention-aware facial features; however, they neglect the dynamic interactions among local-global features. We argue that encoding AU features just from one perspective may not capture the rich contextual information between regional and global face features, as well as the detailed variability across AUs, because of the diversity in expression and individual characteristics. In this paper, we propose a novel Multi-level Graph Relational Reasoning Network (termed MGRR-Net ) for facial AU detection. Each layer of MGRR-Net performs a multi-level ( i.e. , region-level, pixel-wise and channel-wise level) feature learning. On the one hand, the region-level feature learning from the local face patch features via graph neural network can encode the correlation across different AUs. On the other hand, pixel-wise and channel-wise feature learning via graph attention networks (GAT) enhance the discrimination ability of AU features by adaptively recalibrating feature responses of pixels and channels from global face features. The hierarchical fusion strategy combines features from the three levels with gated fusion cells to improve AU discriminative ability. Extensive experiments on DISFA and BP4D AU datasets show that the proposed approach achieves superior performance than the state-of-the-art methods.

CaFGraph: Context-aware Facial Multi-graph Representation for Facial Action Unit Recognition.

Multi-Level Adaptive Region of Interest and Graph Learning for Facial Action Unit Recognition

A Novel Dual-channel Graph Convolutional Neural Network for Facial Action Unit Recognition

STA-GCN - Spatio-Temporal AU Graph Convolution Network for Facial Micro-expression Recognition.

MGRR-Net: Multi-level Graph Relational Reasoning Network for Facial Action Units Detection

MGRR-Net: Multi-level Graph Relational Reasoning Network for Facial Action Unit Detection

Data-aware relation learning-based graph convolution neural network for facial action unit recognition

Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection

Graph-Based Multi-Modal Multi-View Fusion for Facial Action Unit Recognition

Facial Action Units Detection Aided by Global-Local Expression Embedding

AU-aware Graph Convolutional Network for Macroand Micro-expression Spotting.

Improving Facial Attribute Recognition by Group and Graph Learning

GCANet: Geometry Cues-aware Facial Expression Recognition based on Graph Convolutional Networks

Facial Expression and Action Unit Recognition Augmented by Their Dependencies on Graph Convolutional Networks

Facial Action Units Intensity Estimation via Graph Relation Network.

Multi-scale Dynamic and Hierarchical Relationship Modeling for Facial Action Units Recognition

Facial Expression Recognition Via Deep Action Units Graph Network Based on Psychological Mechanism

Micro-expression Recognition Based on Facial Graph Representation Learning and Facial Action Unit Fusion

Facial Action Unit Detection Via Adaptive Attention and Relation.

Context Aware Graph Convolution for Skeleton-Based Action Recognition.

Multi-Scale Region with Local Relationship Learning for Facial Action Unit Detection