Abstract:Face recognition plays the significant role in many human-computer interaction decvices and applications, whose access control systems are based on the verification of face biometrical features. Though great improvement in the recognition performances have been achieved, when under some specific conditions like faces with occlusions, the performance would suffer a severe drop. Occlusion is one of the most significant reasons for the performance degrade of the existing general face recognition systems. The biggest problem in occluded face recognition (OFR) lies in the lack of the occluded face data. To mitigate this problem, this paper has proposed one new OFR network DOMG-OFR (Dynamic Occlusion Mask Generator based Occluded Face Recognition), which keeps trying to generate the most informative occluded face training samples on feature level dynamically, in this way, the recognition model would always be fed with the most valuable training samples so as to save the labor in preparing the synthetic data while simultaneously improving the training efficiency. Besides, this paper also proposes one new module called Decision Module (DM) in an attempt to combine both the merits of the two mainstream methodologies in OFR which are face image reconstruction based methodologies and the face feature filtering based methodologies. Furthermore, to enable the existing face deocclusion methods that mostly target at near frontal faces to work well on faces under large poses, one head pose aware deocclusion pipeline based on the Condition Generative Adversarial Network (CGAN) is proposed. In the experimental parts, we have also investigated the effects of the occlusions upon face recognition performance, and the validity and the efficiency of our proposed Decision based OFR pipeline has been fully proved. Through comparing both the verification and the recognition performance upon both the real occluded face datasets and the synthetic occluded face datasets with other existing works, our proposed OFR architecture has demonstrated obvious advantages over other works.

Recovery-Based Occluded Face Recognition by Identity-Guided Inpainting

Occluded Face Recognition in the Wild by Identity-Diversity Inpainting.

Face recognition with contiguous occlusion using linear regression and level set method

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Lower Face Inpainting Aiming at Face Recognition under Occlusions

Face Image Inpainting Based on Generative Adversarial Network

Occlusion Recovery Face Recognition Based on Information Reconstruction

Face inpainting based on GAN by facial prediction and fusion as guidance information

Fine-Grained Blind Face Inpainting with 3D Face Component Disentanglement

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

Face Image Inpainting Using Attribute Guided

Reference-Guided Large-Scale Face Inpainting with Identity and Texture Control

Face Inpainting Via Nested Generative Adversarial Networks

Mask Removal : Face Inpainting Via Attributes

Patch-guided Facial Image Inpainting by Shape Propagation

FaceInpainter: High Fidelity Face Adaptation to Heterogeneous Domains

ShowFace: Coordinated Face Inpainting with Memory-Disentangled Refinement Networks

Robust Deep Auto-Encoder For Occluded Face Recognition

Identity Preserving Face Completion for Large Ocular Region Occlusion

A New Occluded Face Recognition Framework with Combination of Both Deocclusion and Feature Filtering Methods

Identity-preserving Face Recovery from Portraits