Abstract:Facial expression recognition (FER) has received significant attention in the past decade with witnessed progress, but data inconsistencies among different FER datasets greatly hinder the generalization ability of the models learned on one dataset to another. Recently, a series of cross-domain FER algorithms (CD-FERs) have been extensively developed to address this issue. Although each declares to achieve superior performance, comprehensive and fair comparisons are lacking due to inconsistent choices of the source/target datasets and feature extractors. In this work, we first propose to construct a unified CD-FER evaluation benchmark, in which we re-implement the well-performing CD-FER and recently published general domain adaptation algorithms and ensure that all these algorithms adopt the same source/target datasets and feature extractors for fair CD-FER evaluations. Based on the analysis, we find that most of the current state-of-the-art algorithms use adversarial learning mechanisms that aim to learn holistic domain-invariant features to mitigate domain shifts. However, these algorithms ignore local features, which are more transferable across different datasets and carry more detailed content for fine-grained adaptation. Therefore, we develop a novel adversarial graph representation adaptation (AGRA) framework that integrates graph representation propagation with adversarial learning to realize effective cross-domain holistic-local feature co-adaptation. Specifically, our framework first builds two graphs to correlate holistic and local regions within each domain and across different domains, respectively. Then, it extracts holistic-local features from the input image and uses learnable per-class statistical distributions to initialize the corresponding graph nodes. Finally, two stacked graph convolution networks (GCNs) are adopted to propagate holistic-local features within each domain to explore their interaction and across different domains for holistic-local feature co-adaptation. In this way, the AGRA framework can adaptively learn fine-grained domain-invariant features and thus facilitate cross-domain expression recognition. We conduct extensive and fair comparisons on the unified evaluation benchmark and show that the proposed AGRA framework outperforms previous state-of-the-art methods.

Cross-database facial expression recognition based on hybrid improved unsupervised domain adaptation

USTST: Unsupervised Self-Training Similarity Transfer for Cross-Domain Facial Expression Recognition

Cross-Database Facial Expression Recognition via Unsupervised Domain Adaptive Dictionary Learning.

Cross-Domain Facial Expression Recognition via Contrastive Warm up and Complexity-Aware Self-Training

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

Unsupervised Facial Expression Recognition Using Domain Adaptation Based Dictionary Learning Approach

Cross-Database Facial Expression Recognition With Domain Alignment And Compact Feature Learning

Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning

Multi-Representation Joint Dynamic Domain Adaptation Network for Cross-Database Facial Expression Recognition

Cross-Domain Facial Expression Recognition Through Reliable Global–Local Representation Learning and Dynamic Label Weighting

Cross-Domain Facial Expression Recognition by Combining Transfer Learning and Face-Cycle Generative Adversarial Network

Region Attention Enhanced Unsupervised Cross-Domain Facial Emotion Recognition

Cross-domain Facial Expression Recognition Via an Intra-Category Common Feature and Inter-Category Distinction Feature Fusion Network

Cross-Database Facial Expression Recognition Based on Fine-Tuned Deep Convolutional Network

Adaptive Global-Local Representation Learning and Selection for Cross-Domain Facial Expression Recognition

CF-DAN: Facial-expression recognition based on cross-fusion dual-attention network

Learning with Alignments: Tackling the Inter- and Intra-domain Shifts for Cross-multidomain Facial Expression Recognition

Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach.

Enhanced Sample Self-Revised Network for Cross-Dataset Facial Expression Recognition

Super Wide Regression Network for Unsupervised Cross-Database Facial Expression Recognition