Abstract:Pose-robust personalized facial expression recognition is rather challenging, as facial expressions are subject-related and pose-dependent. Multi-source domain adaptation tries to leverage knowledge from multiple source domains to boost the performance of the target domain. For pose-robust personalized facial expression recognition, the images of the source domain are from multiple sources since the images are under different poses. Thus, in this paper, we propose a novel unsupervised multi-source domain adaptation framework for pose-robust personalized facial expression recognition. The proposed framework consists of five components: a source encoder, a target encoder, an expression classifier, a view discriminator, and a domain discriminator. The source encoder and target encoder learn facial representations from facial images in the training and testing sets, respectively. The expression classifier recognizes expressions from the learned representations. The view discriminator classifies poses. The domain discriminator distinguishes the learned representations of the source domain from those of the target domain. The source encoder works cooperatively with the expression classifier and adversarially with the view discriminator. The target encoder aims to learn domain robust representations and fool the domain discriminator, while the domain discriminator tries to distinguish between the source and target domains. Through adversarial learning, the distribution of the learned representations from the source domain converges to that from the target domain. Thus, the feature representation extracted by the target encoder is pose-invariant and target subject-specific. Experimental results demonstrate the superiority of the proposed method compared to related works.

Face Recognition Via Domain Adaptation And Manifold Distance Metric Learning

Image distance measurement based on manifold learning and manifold high-order approximation

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Manifold-manifold distance and its application to face recognition with image sets.

Manifold-Manifold Distance with application to face recognition based on image set

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Multi-manifold Metric Learning for Face Recognition Based on Image Sets

Facial Expression Recognition on Multiple Manifolds

Lie Group Manifold Analysis: an Unsupervised Domain Adaptation Approach for Image Classification

Nearest Manifold Approach for Face Recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Manifold transfer subspace learning based on double relaxed discriminative regression

Face Detection Based on the Manifold

Unsupervised Domain Adaptation with Regularized Optimal Transport for Multimodal 2D+3D Facial Expression Recognition

Head pose estimation based on manifold embedding and distance metric learning

Coupled discriminative manifold alignment for low-resolution face recognition

Three-Dimensional Face Pose Estimation Based on Novel Nonlinear Discriminant Representation

Discriminative Multimanifold Analysis for Face Recognition from a Single Training Sample Per Person

Two-Dimensional Maximum Local Variation Based on Image Euclidean Distance for Face Recognition

Face Recognition Based on Riemannian Manifold Learning

Pose-robust personalized facial expression recognition through unsupervised multi-source domain adaptation