Abstract:Recent face recognition algorithm can achieve high accuracy when the tested face samples are frontal. However, when the face pose changes largely, the performance of existing methods drop drastically. Efforts on pose-robust face recognition are highly desirable, especially when each face class has only one frontal training sample. In this study, we propose a 2D face fitting-assisted 3D face reconstruction algorithm that aims at recognizing faces of different poses when each face class has only one frontal training sample. For each frontal training sample, a 3D face is reconstructed by optimizing the parameters of 3D morphable model (3DMM). By rotating the reconstructed 3D face to different views, pose virtual face images are generated to enlarge the training set of face recognition. Different from the conventional 3D face reconstruction methods, the proposed algorithm utilizes automatic 2D face fitting to assist 3D face reconstruction. We automatically locate 88 sparse points of the frontal face by 2D face-fitting algorithm. Such 2D face-fitting algorithm is so-called Random Forest Embedded Active Shape Model, which embeds random forest learning into the framework of Active Shape Model. Results of 2D face fitting are added to the 3D face reconstruction objective function as shape constraints. The optimization objective energy function takes not only image intensity, but also 2D fitting results into account. Shape and texture parameters of 3DMM are thus estimated by fitting the 3DMM to the 2D frontal face sample, which is a non-linear optimization problem. We experiment the proposed method on the publicly available CMUPIE database, which includes faces viewed from 11 different poses, and the results show that the proposed method is effective and the face recognition results toward pose variants are promising.

Pose normalization using generic 3d face model as a priori for pose-insensitive face recognition

Pose Normalization For Robust Face Recognition Based On Statistical Affine Transformation

Face Pose Normalization and Simulation Methods Based on Multi-View Face Alignment

Continuous Pose Normalization for Pose-Robust Face Recognition

3D-Guided Frontal Face Generation for Pose-Invariant Recognition

Pose-invariant Face Recognition with Homography-Based Normalization.

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Improved 3D Assisted Pose-Invariant Face Recognition

Automatic pose normalization for open-set single-sample face recognition in video surveillance

CP-GAN: A Cross-Pose Profile Face Frontalization Boosting Pose-Invariant Face Recognition

Face recognition across different poses using a single 2D model view

Pose-Invariant 3D Face Alignment

Pose Invariant Face Recognition under Arbitrary Illumination Based on 3D Face Reconstruction

Locally Linear Regression for Pose-Invariant Face Recognition

Joint face normalization and representation learning for face recognition

Pseudo Facial Generation With Extreme Poses for Face Recognition.

2D Face Fitting-Assisted 3D Face Reconstruction for Pose-Robust Face Recognition.

Multi-task pose-invariant face recognition.

Triplet Angular Loss for Pose-Robust Face Recognition

Learning a High Fidelity Pose Invariant Model for High-resolution Face Frontalization