Abstract:Registration algorithms performed on point clouds or range images of face scans have been successfully used for automatic 3D face recognition under expression variations, but have rarely been investigated to solve pose changes and occlusions mainly since that the basic landmarks to initialize coarse alignment are not always available. Recently, local feature-based SIFT-like matching proves competent to handle all such variations without registration. In this paper, towards 3D face recognition for real-life biometric applications, we significantly extend the SIFT-like matching framework to mesh data and propose a novel approach using fine-grained matching of 3D keypoint descriptors. First, two principal curvature-based 3D keypoint detectors are provided, which can repeatedly identify complementary locations on a face scan where local curvatures are high. Then, a robust 3D local coordinate system is built at each keypoint, which allows extraction of pose-invariant features. Three keypoint descriptors, corresponding to three surface differential quantities, are designed, and their feature-level fusion is employed to comprehensively describe local shapes of detected keypoints. Finally, we propose a multi-task sparse representation based fine-grained matching algorithm, which accounts for the average reconstruction error of probe face descriptors sparsely represented by a large dictionary of gallery descriptors in identification. Our approach is evaluated on the Bosphorus database and achieves rank-one recognition rates of 96.56, 98.82, 91.14, and 99.21 % on the entire database, and the expression, pose, and occlusion subsets, respectively. To the best of our knowledge, these are the best results reported so far on this database. Additionally, good generalization ability is also exhibited by the experiments on the FRGC v2.0 database.

Nonrigid-Deformation Recovery for 3D Face Recognition Using Multiscale Registration

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Learning Deformation Model for Expression-Robust 3D Face Recognition

3D Face Recognition by Deforming the Normal Face

Robust 3D Face Recognition by Local Shape Difference Boosting

Estimating Inter-Personal Deformation with Multi-Scale Modelling Between Expression for Three-Dimensional Face Recognition

Expression-Robust 3d Face Recognition Based on Feature-Level Fusion and Feature-Region Fusion

Robust 3d Face Recognition Based on Rejection and Adaptive Region Selection

Non-Rigid Point Cloud Matching Based on Invariant Structure for Face Deformation

An Automatic Multi-Sample 3d Face Registration Method Based on Thin Plate Spline and Deformable Model

3D Face Recognition Algorithm Based on Nose Tip Contour and Radial Curve

Robust 3D face recognition based on resolution invariant features

3d Face Recognition In The Presence Of Expression: A Guidance-Based Constraint Deformation Approach

Towards Semantically-Consistent Deformable 2D-3D Registration for 3D Craniofacial Structure Estimation from A Single-View Lateral Cephalometric Radiograph

Automatic and robust 3D face registration using multiresolution Spherical Depth Map

A Novel Expression Deformation Model for 3D Face Recognition.

Non-rigid Visible and Infrared Face Registration Via Regularized Gaussian Fields Criterion.

Towards 3d Face Recognition in the Real: A Registration-Free Approach Using Fine-Grained Matching of 3d Keypoint Descriptors

Efficient 3D face recognition handling facial expression and hair occlusion

Sparse ICP with Resampling and Denoising for 3D Face Verification