Abstract:Cross-domain Facial Expression Recognition (FER) aims to safely transfer the learned knowledge from labeled source data to unlabeled target data, which is challenging due to the subtle difference between various expressions and the large discrepancy between domains. Existing methods mainly focus on reducing the domain shift for transferable features but fail to learn discriminative representations for recognizing facial expression, which may result in negative transfer under cross-domain settings. To this end, we propose a novel Deep Margin-Sensitive Representation Learning (DMSRL) framework, which can extract multi-level discriminative features during sematic-aware domain adaptation. Specifically, we design a semantic metric learning module based on the category prior of source data and generated pseudo labels of target data, which can facilitate discriminative intra-domain representation learning and transferable inter-domain knowledge discovery by enlarging the category margin. Moreover, we develop a mutual information minimization module by simultaneously distilling the domain-invariant components and eliminating the domain-sensitive ones, which benefits discriminative transferable feature learning by generating accurate pseudo target labels. Furthermore, instead of only utilizing the global features, we formulate a multi-level feature extracting module to concurrently get the local ones, which contain detailed information to distinguish the small changes among different expressions. These modules are jointly utilized in our DMSRL in an end-to-end manner to ensure the positive transfer of source knowledge. Extensive experimental results on seven databases demonstrate that our DMSRL can achieve superior performance against state-of-the-art baselines.

Domain Regeneration for Cross-Database Micro-Expression Recognition

Cross-Database Micro-Expression Recognition Exploiting Intradomain Structure

Cross-Database Micro-Expression Recognition: A Benchmark

Seeking Salient Facial Regions for Cross-Database Micro-Expression Recognition

Toward Bridging Microexpressions From Different Domains

Cross-database Micro-Expression Recognition with Deep Convolutional Networks

Cross-Database Micro-Expression Recognition Based on a Dual-Stream Convolutional Neural Network

Cross-Database Facial Expression Recognition With Domain Alignment And Compact Feature Learning

Multiple source domain adaptation in micro-expression recognition

Multi-Representation Joint Dynamic Domain Adaptation Network for Cross-Database Facial Expression Recognition

Cross-Database Micro-Expression Recognition: A Style Aggregated and Attention Transfer Approach

Casme Ii: an Improved Spontaneous Micro-Expression Database and the Baseline Evaluation

Cross-database non-frontal facial expression recognition based on transductive deep transfer learning

Cross-domain Sample Relationship Learning For Facial Expression Recognition

Micro-Expression Recognition Enhanced by Macro-Expression from Spatial-Temporal Domain.

Cross-Database Facial Expression Recognition Based on Fine-Tuned Deep Convolutional Network

Deep Emotion Transfer Network for Cross-database Facial Expression Recognition

A Spontaneous Micro-expression Database: Inducement, Collection and Baseline

Super Wide Regression Network for Unsupervised Cross-Database Facial Expression Recognition

Deep Margin-Sensitive Representation Learning for Cross-Domain Facial Expression Recognition

Cross-database facial expression recognition based on hybrid improved unsupervised domain adaptation