Abstract:Heterogeneous face recognition (HFR) is a challenging problem in face recognition and subject to large textural and spatial structure differences of face images. Different from conventional face recognition in homogeneous environments, there exist many face images taken from different sources (including different sensors or different mechanisms) in reality. In addition, limited training samples of cross-modality pairs make HFR more challenging due to the complex generation procedure of these images. Despite the great progress that has been achieved in recent years, existing works mainly focus on HFR from only cross-modality image matching. However, it is more practical to obtain both facial images and semantic descriptions about facial attributes in real-world situations, in which the semantic description clues are nearly always obtained during the process of image generation. Motivated by human cognitive mechanisms, we naturally utilize the explicit invariant semantic description, i.e., face attributes, to help address the gap among face images of different modalities. Existing facial attributes-related face recognition methods primarily regard attributes as the high-level features used to enhance recognition performance, ignoring the inherent relationship between face attributes and identities. In this article, we propose novel coupled attribute learning for the HFR (CAL-HFR) method without labeling the attributes manually. Deep convolutional networks are employed to directly map face images in heterogeneous scenarios to a compact common space where distances are taken as dissimilarities of pairs. Coupled attribute guided triplet loss (CAGTL) is designed to train an end-to-end HFR network that can effectively eliminate defects of incorrectly estimated attributes. Extensive experiments on multiple heterogeneous scenarios demonstrate that the proposed method achieves superior performance compared with that of state-of-the-art methods. Furthermore, we make publicly -vailable our generated pairwise annotated heterogeneous facial attribute database for evaluation and promoting related research.

Data Augmentation-Based Joint Learning for Heterogeneous Face Recognition.

Asymmetric Joint Learning for Heterogeneous Face Recognition.

Coupled Attribute Learning for Heterogeneous Face Recognition

Heterogeneous Hashing Network for Face Retrieval Across Image and Video Domains

DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition

Modality-agnostic Augmented Multi-Collaboration Representation for Semi-supervised Heterogenous Face Recognition

Adversarial Discriminative Heterogeneous Face Recognition.

Shared Representation Learning for Heterogeneous Face Recognition

Heterogeneous Face Recognition via Face Synthesis With Identity-Attribute Disentanglement

Discriminant Deep Feature Learning Based on Joint Supervision Loss and Multi-layer Feature Fusion for Heterogeneous Face Recognition.

Multi-Margin Based Decorrelation Learning for Heterogeneous Face Recognition.

Heterogeneous Face Recognition Based on Multiple Deep Networks with Scatter Loss and Diversity Combination

Coupled Deep Learning for Heterogeneous Face Recognition

Graphical Representation for Heterogeneous Face Recognition

Sparse Graphical Representation Based Discriminant Analysis for Heterogeneous Face Recognition.

Deep Attribute Guided Representation for Heterogeneous Face Recognition

Heterogeneous Visible-Thermal and Visible-Infrared Face Recognition Using Cross-Modality Discriminator Network and Unit-Class Loss

Hierarchical Discriminant Feature Learning for Cross-Modal Face Recognition.

Coupled Discriminative Feature Learning for Heterogeneous Face Recognition

Heterogeneous Face Recognition Using Domain Invariant Units

Learning modality-invariant features for heterogeneous face recognition