Abstract:The existing occlusion face recognition algorithms almost tend to pay more attention to the visible facial components. However, these models are limited because they heavily rely on existing face segmentation approaches to locate occlusions, which is extremely sensitive to the performance of mask learning. To tackle this issue, we propose a joint segmentation and identification feature learning framework for end-to-end occlusion face recognition. More particularly, unlike employing an external face segmentation model to locate the occlusion, we design an occlusion prediction module supervised by known mask labels to be aware of the mask. It shares underlying convolutional feature maps with the identification network and can be collaboratively optimized with each other. Furthermore, we propose a novel channel refinement network to cast the predicted single-channel occlusion mask into a multi-channel mask matrix with each channel owing a distinct mask map. Occlusion-free feature maps are then generated by projecting multi-channel mask probability maps onto original feature maps. Thus, it can suppress the representation of occlusion elements in both the spatial and channel dimensions under the guidance of the mask matrix. Moreover, in order to avoid misleading aggressively predicted mask maps and meanwhile actively exploit usable occlusion-robust features, we aggregate the original and occlusion-free feature maps to distill the final candidate embeddings by our proposed feature purification module. Lastly, to alleviate the scarcity of real-world occlusion face recognition datasets, we build large-scale synthetic occlusion face datasets, totaling up to 980193 face images of 10574 subjects for the training dataset and 36721 face images of 6817 subjects for the testing dataset, respectively. Extensive experimental results on the synthetic and real-world occlusion face datasets show that our approach significantly outperforms the state-of-the-art in both 1:1 face verification and 1:N face identification.

Biased Feature Learning for Occlusion Invariant Face Recognition

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Face recognition with contiguous occlusion using linear regression and level set method

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Joint Segmentation and Identification Feature Learning for Occlusion Face Recognition

Robust Discriminative Nonnegative Dictionary Learning for Occluded Face Recognition

Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification.

Adversarially Learning Occlusions by Backpropagation for Face Recognition

Occluded Facial Expression Recognition with Step-Wise Assistance from Unpaired Non-Occluded Images.

Locality-Aware Channel-Wise Dropout for Occluded Face Recognition

Robust Discriminative Nonnegative Patch Alignment for Occluded Face Recognition.

Biased Subspace Learning for Misalignment-Robust Facial Expression Recognition

Learning Robust and Discriminative Low-Rank Representations for Face Recognition with Occlusion.

Invariant Feature Regularization for Fair Face Recognition

Occluded Facial Expression Recognition Enhanced Through Privileged Information.

Improvised contrastive loss for improved face recognition in open-set nature

Occlusion Recovery Face Recognition Based on Information Reconstruction

Face Recognition with Partial Occlusion.

Frontal-Centers Guided Face: Boosting Face Recognition by Learning Pose-Invariant Features

An efficient method for occluded face recognition

A Novel Approach Inspired by Optic Nerve Characteristics for Few-Shot Occluded Face Recognition