Abstract:Unconstrained face recognition has achieved state-of-the-art performance with the help of the powerful representation capabilities of deep convolutional neural networks. However, face recognition always suffers from other intra-class imbalances due to the influence of pose variations present in the real world, which significantly degrades the performance, especially for tilted face recognition under surveillance videos, which is rarely studied. Tilted face recognition is more challenging than frontal and profile face recognition due to the effect of self-obscuration. To this end, we consider promoting the frontalization of tilted faces in the implicit space, while preserving identity information. In this paper, we propose an implicit spatial pose consistent transfer network (PCTN) that exploits the prior guidance of pose information to enhance the model’s ability to perceive pose. Specifically, we first develop the multi-path attention block (MPAB), which is used as the main block for feature embedding in deep networks. Such a design is employed to enhance the relevance of multi-layer convolutional features and provide a powerful foundation for the deep asymptotic transfer of feature frontalization. Then, the pose consistent transfer module (PCTM) combines pose labels and deep embedding features to learn robust discriminative information. PCTM consists of two parts: the pose guidance block (PGB) explores the implicit nonlinear feature mapping from pose faces to frontal faces in feature space, and the attention compensation module (ACM) aims to exploit the complementarity of dense and sparse features, enhancing pose-related features and suppressing pose-unrelated features in terms of both spatial-wise and channel-wise. Furthermore, we investigate the performance comparison on datasets with multiple pose variations without performance degradation. Extensive experimental results on multiple benchmark datasets demonstrate the effectiveness of our proposed method.

Boosting Face Recognition under Drastic Views Using a Pose AutoAugment Manner

Data Augmentation for Face Recognition

Frontal-Centers Guided Face: Boosting Face Recognition by Learning Pose-Invariant Features

Robust 3D Face Recognition by Local Shape Difference Boosting

A new approach for small sample face recognition with pose variation by fusing Gabor encoding features and deep features

Face Super-Resolution Via Progressive-Scale Boosting Network

Pose Aided Deep Convolutional Neural Networks for Face Alignment.

DotFAN: A Domain-transferred Face Augmentation Network for Pose and Illumination Invariant Face Recognition

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Implicit Space Pose Consistent Transfer Network for Deep Face Verification

Enhancement and Optimisation of Human Pose Estimation with Multi-Scale Spatial Attention and Adversarial Data Augmentation

Robust Face Recognition via Multimodal Deep Face Representation

Incremental Learning-Enhanced Ensemble Convolutional Neural Network for Robust Pose-Invariant Face Recognition

Landmark Perturbation-Based Data Augmentation for Unconstrained Face Recognition

Pose-robust Feature Learning for Pose-Invariant Face Recognition

Attention-guided Progressive Mapping for Profile Face Recognition.

APA: Adaptive Pose Alignment for Robust Face Recognition

Improving Face Recognition by Pose-Aware Quality Assessment and Judgement

Continuous Pose Normalization for Pose-Robust Face Recognition

CP-GAN: A Cross-Pose Profile Face Frontalization Boosting Pose-Invariant Face Recognition

Data Augmentation for Unbalanced Face Recognition Training Sets