Abstract:In-the-wild Dynamic facial expression recognition (DFER) encounters a significant challenge in recognizing emotion-related expressions, which are often temporally and spatially diluted by emotion-irrelevant expressions and global context respectively. Most of the prior DFER methods model tightly coupled spatiotemporal representations which may incorporate weakly relevant features, leading to information redundancy and emotion-irrelevant context bias. Several DFER methods have highlighted the significance of dynamic information, but utilize explicit manners to extract dynamic features with overly strong prior knowledge. In this paper, we propose a novel Implicit Facial Dynamics Disentanglement framework (IFDD). Through expanding wavelet lifting scheme to fully learnable framework, IFDD disentangles emotion-related dynamic information from emotion-irrelevant global context in an implicit manner, i.e., without exploit operations and external guidance. The disentanglement process of IFDD contains two stages, i.e., Inter-frame Static-dynamic Splitting Module (ISSM) for rough disentanglement estimation and Lifting-based Aggregation-Disentanglement Module (LADM) for further refinement. Specifically, ISSM explores inter-frame correlation to generate content-aware splitting indexes on-the-fly. We preliminarily utilize these indexes to split frame features into two groups, one with greater global similarity, and the other with more unique dynamic features. Subsequently, LADM first aggregates these two groups of features to obtain fine-grained global context features by an updater, and then disentangles emotion-related facial dynamic features from the global context by a predictor. Extensive experiments on in-the-wild datasets have demonstrated that IFDD outperforms prior supervised DFER methods with higher recognition accuracy and comparable efficiency.

Toward Identity-Invariant Facial Expression Recognition: Disentangled Representation via Mutual Information Perspective

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Disentangling Identity and Pose for Facial Expression Recognition

Cross-domain Facial Expression Recognition Via Disentangling Identity Representation

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

Disentanglement for Discriminative Visual Recognition

Identity-Enhanced Network for Facial Expression Recognition

Facial Expression Recognition Using Disentangled Adversarial Learning

Facial Expression Recognition by Expression-Specific Representation Swapping

Disentangled Representation for Age-Invariant Face Recognition: A Mutual Information Minimization Perspective

DrFER: Learning Disentangled Representations for 3D Facial Expression Recognition

Learning informative and discriminative semantic features for robust facial expression recognition

Dynamic Multi-Channel Metric Network for Joint Pose-Aware and Identity-Invariant Facial Expression Recognition

3D-FERNet: A Facial Expression Recognition Network utilizing 3D information

Collaborative expression representation using peak expression and intra class variation face images for practical subject-independent emotion recognition in videos

THIN: THrowable Information Networks and Application for Facial Expression Recognition In The Wild

Deep Spatial and Channel Sliding Attention Patches for Pose-invariant Facial Expression Recognition

Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensation

Lifting Scheme-Based Implicit Disentanglement of Emotion-Related Facial Dynamics in the Wild

Real-Time Facial Expression Recognition Based on Attention Mechanism

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition