Abstract:Pose variation is one of the key challenges in face recognition. Conventional techniques mainly focus on face frontalization or face augmentation in image space. However, transforming face images in image space is not guaranteed to preserve the lossless identity features of the original image. Moreover, these methods suffer from more computational costs and memory requirements due to the additional models. We argue that it is more desirable to perform feature transformation in hierarchical feature space rather than image space, which can take advantage of different feature levels and benefit from joint learning with representation learning. To this end, we propose a lightweight and easy-to-implement attention block, named Pose Attention Module (PAM), for pose-invariant face recognition. Specifically, PAM performs frontal-profile feature transformation in hierarchical feature space by learning residuals between pose variations with a soft gate mechanism. We validated the effectiveness of PAM block design through extensive ablation studies and verified the performance on several popular benchmarks, including LFW, CFP-FP, AgeDB-30, CPLFW, and CALFW. Experimental results show that our method not only outperforms state-of-the-art methods but also effectively reduces memory requirements by more than 75 times. It is noteworthy that our method is not limited to face recognition with large pose variations. By adjusting the soft gate mechanism of PAM to a specific coefficient, such semantic attention block can easily extend to address other intra-class imbalance problems in face recognition, including large variations in age, illumination, expression, etc.

A Novel and Complete Framework for Face Recognition with Pose Variations Using a Single Image.

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Continuous Pose Normalization for Pose-Robust Face Recognition

Face Recognition Based On Pose-Variant Image Synthesis And Multi-Level Multi-Feature Fusion

Multi-task pose-invariant face recognition.

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Pose Normalization For Robust Face Recognition Based On Statistical Affine Transformation

Face Pose Normalization and Simulation Methods Based on Multi-View Face Alignment

Robust Face Recognition by Constrained Part-based Alignment.

Locally Linear Regression for Pose-Invariant Face Recognition

Algorithm Using Supervised Subspace Learning and Non-Local Representation for Pose Variation Recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Improved 3D Assisted Pose-Invariant Face Recognition

PAM: Pose Attention Module for Pose-Invariant Face Recognition

Face identification using reference-based features with message passing model

Pose-robust Feature Learning for Pose-Invariant Face Recognition

Frontal Face Synthesizing According to Multiple Non-Frontal Inputs and Its Application in Face Recognition.

Image set-based face recognition using pose estimation with facial landmarks

Frontal Face Synthesis Based on Multiple Pose-Variant Images for Face Recognition.