Abstract:With the accomplishment of deep neural networks, face recognition methods have achieved great success in research and are now being applied at a human level. However, existing face recognition models fail to achieve state-of-the-art performance in recognizing occluded face images, which are common scenarios captured in the real world. One of the potential reasons for this is the lack of large-scale training datasets, requiring labour-intensive and costly labelling of the occlusions. To resolve these issues, we propose an Adversarially Learning Occlusions by Backpropagation (ALOB) model, a simple yet powerful double-network framework used to mitigate manual labelling by contrastively learning the corrupted features against personal identity labels, thereby maximizing the loss. To investigate the performance of the proposed method, we compared our model to the existing state-of-the-art methods, which function under the supervision of occlusion learning, in various experiments. Extensive experimentation on LFW, AR, MFR2, and other synthetic masked or occluded datasets confirmed the effectiveness of the proposed model in occluded face recognition by sustaining better results in terms of masked face recognition and general face recognition. For the AR datasets, the ALOB model outperformed other advanced methods by obtaining a 100% recognition rate for images with sunglasses (protocols 1 and 2). We also achieved the highest accuracies of 94.87%, 92.05%, 78.93%, and 71.57% TAR@FAR = 1 × 10-3 in LFW-OCC-2.0 and LFW-OCC-3.0, respectively. Furthermore, the proposed method generalizes well in terms of FR and MFR, yielding superior results in three datasets, LFW, LFW-Masked, and MFR2, and producing accuracies of 98.77%, 97.62%, and 93.76%, respectively.

Real-Time Face Occlusion Recognition Algorithm Based on Feature Fusion.

Face recognition with contiguous occlusion using linear regression and level set method

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

A real-time hand gesture recognition method

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers.

Anti-occlusion face recognition algorithm based on a deep convolutional neural network

Real-Time 3d Face Recognition With The Integration Of Depth And Intensity Images

Bayesian Face Recognition Approach Based on Feature Fusion

Facial Expression Recognition under Partial Occlusion Based on Fusion of Global and Local Features

Real-time detection tracking and recognition algorithm based on multi-target faces

Adversarially Learning Occlusions by Backpropagation for Face Recognition

Real-Time Hand Gesture Recognition Based on A Fusion Learning Method

Facial Expression Recognition Based on Local Feature Fusion of Convolutional Neural Network

Feature Fusion Of Hog And Wld For Facial Expression Recognition

Face Recognition Based on Adaptive Weighting and Fuzzy Fusion with Single Training Sample.

Research on facial expression recognition based on Multimodal data fusion and neural network

Face recognition with a small occluded training set using spatial and statistical pooling.

YOLOMask, an Instance Segmentation Algorithm Based on Complementary Fusion Network