Abstract:Heterogeneous face recognition (HFR) is still a challenging problem in computer vision community due to large appearance difference between near infrared (NIR) and visible light (VIS) modalities. Recently, breakthroughs have been made for traditional face recognition by applying deep learning on a huge amount of labeled VIS face samples. However, the same deep learning approach cannot be simply applied to HFR task due to large domain difference as well as insufficient pairwise images in different modalities during training. In general, the pooling layer of deep network can play the role of feature reduction, but also lead to the loss of useful face information, resulting in a decrease in the performance of HFR problem. It is important to eliminate modal-related information and retain more facial identity information. In this paper, we propose a novel method called Discriminant Deep Feature Learning Based on Joint Supervision Loss and Multi-layer Feature Fusion (DDFLJM) for HFR task. In most of the available CNNs, the softmax loss function is used as the supervision signal to train the deep model. In order to enhance the discriminative power of the deeply learned features, this paper proposes a new loss function called Scatter Loss (SL), which embeds both inter- and intra-class information for effectively training the deep model. To make full use of the various layers of the deep network, a Dimension Reduction Block (DRB) is designed to effectively extract the auxiliary features on multiple mid-level layers. An orthogonality constraint is introduced to the DRB block to reduce spectrum variations of two different modalities. The proposed SL is applied to multiple layers of network for joint supervision training, which enables multiple layers of the network to obtain discriminative identity features. Moreover, a Modified Gate Two-stream Neural Network (MGTNN) is adopted to fuse multiple-layer features. Extensive experiments are carried out on two challenging NIR-VIS HFR datasets CASIA NIR-VIS 2.0 and Oulu-CASIA NIR-VIS, demonstrating the superiority of the proposed method.

Learning Deep Discriminative Face Features by Customized Weighted Constraint

Deep compact discriminative representation for unconstrained face recognition

InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition

EnhanceFace: Adaptive Weighted SoftMax Loss for Deep Face Recognition

Deep Face Recognition with Center Invariant Loss

CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognition

CosFace: Large Margin Cosine Loss for Deep Face Recognition

Deep Face Recognition Based on Penalty Cosface.

Range Loss for Deep Face Recognition with Long-tail

A New Deep Learning Method for Multi-label Facial Expression Recognition Based on Local Constraint Features

Improving face representation learning with center invariant loss

Deep Face Recognition Using Adaptively-Weighted Verification Loss Function.

Learning Representative Features Via Constrictive Annular Loss for Image Classification

Orientation Truncated Centre Learning for Deep Face Recognition

Angular Discriminative Deep Feature Learning for Face Verification.

SFace: Sigmoid-Constrained Hypersphere Loss for Robust Face Recognition.

Face Recognition by Landmark Pooling-Based CNN with Concentrate Loss

Discriminant Deep Feature Learning Based on Joint Supervision Loss and Multi-layer Feature Fusion for Heterogeneous Face Recognition.

Collaboratively Weighting Deep and Classic Representation via L2 Regularization for Image Classification

Frontal-Centers Guided Face: Boosting Face Recognition by Learning Pose-Invariant Features

Uniformface: Learning Deep Equidistributed Representation For Face Recognition