Abstract:Recent face recognition algorithm can achieve high accuracy when the tested face samples are frontal. However, when the face pose changes largely, the performance of existing methods drop drastically. Efforts on pose-robust face recognition are highly desirable, especially when each face class has only one frontal training sample. In this study, we propose a 2D face fitting-assisted 3D face reconstruction algorithm that aims at recognizing faces of different poses when each face class has only one frontal training sample. For each frontal training sample, a 3D face is reconstructed by optimizing the parameters of 3D morphable model (3DMM). By rotating the reconstructed 3D face to different views, pose virtual face images are generated to enlarge the training set of face recognition. Different from the conventional 3D face reconstruction methods, the proposed algorithm utilizes automatic 2D face fitting to assist 3D face reconstruction. We automatically locate 88 sparse points of the frontal face by 2D face-fitting algorithm. Such 2D face-fitting algorithm is so-called Random Forest Embedded Active Shape Model, which embeds random forest learning into the framework of Active Shape Model. Results of 2D face fitting are added to the 3D face reconstruction objective function as shape constraints. The optimization objective energy function takes not only image intensity, but also 2D fitting results into account. Shape and texture parameters of 3DMM are thus estimated by fitting the 3DMM to the 2D frontal face sample, which is a non-linear optimization problem. We experiment the proposed method on the publicly available CMUPIE database, which includes faces viewed from 11 different poses, and the results show that the proposed method is effective and the face recognition results toward pose variants are promising.

Face recognition via AAM and multi-features fusion on riemannian manifolds

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

A new facial feature based on the fusion of texture and shape characteristics

Face recognition using laplacianfaces.

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Face alignment based on high order markov random field

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

3D Face Recognition Via Conformal Representation

Robust 3D Face Recognition by Local Shape Difference Boosting

3D face registration by depth-based template matching and active appearance model

Monogenic features based single sample face recognition by kernel sparse representation on multiple Riemannian manifolds

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

2D Face Fitting-Assisted 3D Face Reconstruction for Pose-Robust Face Recognition.

A Robust Facial Expression Recognition Algorithm Based on Multi-Rate Feature Fusion Scheme

Multi-task pose-invariant face recognition.

3-D Facial Expression Recognition via Attention-Based Multichannel Data Fusion Network

Fusing magnitude and phase features with multiple face models for robust face recognition

2D+3D Facial Expression Recognition via Discriminative Dynamic Range Enhancement and Multi-Scale Learning

Efficient Face Alignment via Locality-constrained Representation for Robust Recognition

Fully automatic 3D facial expression recognition using a region-based approach