Abstract:Face recognition techniques have been developed significantly in recent years. However, recognizing faces with partial occlusion is still challenging for existing face recognizers, which is heavily desired in real-world applications concerning surveillance and security. Although much research effort has been devoted to developing face de-occlusion methods, most of them can only work well under constrained conditions, such as all of faces are from a pre-defined closed set of subjects. In this paper, we propose a robust LSTM-Autoencoders (RLA) model to effectively restore partially occluded faces even in the wild. The RLA model consists of two LSTM components, which aims at occlusion-robust face encoding and recurrent occlusion removal respectively. The first one, named multi-scale spatial LSTM encoder, reads facial patches of various scales sequentially to output a latent representation, and occlusion-robustness is achieved owing to the fact that the influence of occlusion is only upon some of the patches. Receiving the representation learned by the encoder, the LSTM decoder with a dual channel architecture reconstructs the overall face and detects occlusion simultaneously, and by feat of LSTM, the decoder breaks down the task of face de-occlusion into restoring the occluded part step by step. Moreover, to minimize identify information loss and guarantee face recognition accuracy over recovered faces, we introduce an identity-preserving adversarial training scheme to further improve RLA. Extensive experiments on both synthetic and real data sets of faces with occlusion clearly demonstrate the effectiveness of our proposed RLA in removing different types of facial occlusion at various locations. The proposed method also provides significantly larger performance gain than other de-occlusion methods in promoting recognition performance over partially-occluded faces.

Robust Modular Linear Regression Based Classification for Face Recognition with Occlusion

Face recognition with contiguous occlusion using linear regression and level set method

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Towards Mask-robust Face Recognition.

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Robust Low-Rank Regularized Regression for Face Recognition with Occlusion

Bilateral Structure Based Matrix Regression Classification for Face Recognition

Modular Two-dimensional Principal Component Regression for Robust Face Recognition ⋆

Learning Robust and Discriminative Low-Rank Representations for Face Recognition with Occlusion.

Robust Face Recognition Via Occlusion Dictionary Learning.

Robust Nuclear Norm Regularized Regression for Face Recognition with Occlusion

Robust Regression Based Face Recognition with Fast Outlier Removal

MSML: Enhancing Occlusion-Robustness by Multi-Scale Segmentation-Based Mask Learning for Face Recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Robust Low-Resolution Face Recognition Via Low-Rank Representation and Locality-Constrained Regression

Robust 3D Face Recognition by Local Shape Difference Boosting

Robust PCA for Face Recognition with Occlusion Using Symmetry Information.

Robust Face Recognition by Constrained Part-based Alignment.

Robust Face Recognition With Occlusion By Fusing Image Gradient Orientations With Markov Random Fields

Face Recognition System with various Expression and Occlusion based on a Novel Block Matching Algorithm and PCA

Robust LSTM-Autoencoders for Face De-Occlusion in the Wild