Abstract:Heterogeneous Face Recognition (HFR) refers to matching cross-domain faces and plays a crucial role in public security. Nevertheless, HFR is confronted with challenges from large domain discrepancy and insufficient heterogeneous data. In this paper, we formulate HFR as a dual generation problem, and tackle it via a novel Dual Variational Generation (DVG-Face) framework. Specifically, a dual variational generator is elaborately designed to learn the joint distribution of paired heterogeneous images. However, the small-scale paired heterogeneous training data may limit the identity diversity of sampling. In order to break through the limitation, we propose to integrate abundant identity information of large-scale visible data into the joint distribution. Furthermore, a pairwise identity preserving loss is imposed on the generated paired heterogeneous images to ensure their identity consistency. As a consequence, massive new diverse paired heterogeneous images with the same identity can be generated from noises. The identity consistency and identity diversity properties allow us to employ these generated images to train the HFR network via a contrastive learning mechanism, yielding both domain-invariant and discriminative embedding features. Concretely, the generated paired heterogeneous images are regarded as positive pairs, and the images obtained from different samplings are considered as negative pairs. Our method achieves superior performances over state-of-the-art methods on seven challenging databases belonging to five HFR tasks, including NIR-VIS, Sketch-Photo, Profile-Frontal Photo, Thermal-VIS, and ID-Camera. The related code will be released at <a class="link-external link-https" href="https://github.com/BradyFU" rel="external noopener nofollow">this https URL</a>.

Gabor features based method using HDR (G-HDR) for multiview face recognition

Face recognition with the robust feature extracted by the generalized Foley-Sammon transform

Robust Feature Extracted by the Generalized Optimal Discriminant Vectors for Face Recognition

Gabor features-based classification using SVM for face recognition

Multi-resolution histograms of local variation patterns (MHLVP) for robust face recognition

DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition

Novel face detection method based on gabor features

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Multi-view Face Analysis Based on Gabor Features

Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Gabor Feature Based Class-Dependence Feature Analysis For Face Recognition

Gabor Boost Linear Discriminant Analysis for face recognition

Face Recognition under Varying Lighting Based on the Probabilistic Model of Gabor Phase

Multiview High Dynamic Range Image Synthesis Using Fuzzy Broad Learning System

Efficient Human Face Recognition Based on Shape and Texture

Discriminant Gaborfaces and Support Vector Machines Classifier for Face Recognition

Multiview Facial Landmark Localization in RGB-D Images Via Hierarchical Regression with Binary Patterns.

A hierarchical algorithm with multi-feature fusion for facial expression recognition

Patch Based Collaborative Representation with Gabor Feature and Measurement Matrix for Face Recognition

A Hierarchical Face Recognition Framework Based On Integrating Template Matching And Svm Classifier