Abstract:Registration algorithms performed on point clouds or range images of face scans have been successfully used for automatic 3D face recognition under expression variations, but have rarely been investigated to solve pose changes and occlusions mainly since that the basic landmarks to initialize coarse alignment are not always available. Recently, local feature-based SIFT-like matching proves competent to handle all such variations without registration. In this paper, towards 3D face recognition for real-life biometric applications, we significantly extend the SIFT-like matching framework to mesh data and propose a novel approach using fine-grained matching of 3D keypoint descriptors. First, two principal curvature-based 3D keypoint detectors are provided, which can repeatedly identify complementary locations on a face scan where local curvatures are high. Then, a robust 3D local coordinate system is built at each keypoint, which allows extraction of pose-invariant features. Three keypoint descriptors, corresponding to three surface differential quantities, are designed, and their feature-level fusion is employed to comprehensively describe local shapes of detected keypoints. Finally, we propose a multi-task sparse representation based fine-grained matching algorithm, which accounts for the average reconstruction error of probe face descriptors sparsely represented by a large dictionary of gallery descriptors in identification. Our approach is evaluated on the Bosphorus database and achieves rank-one recognition rates of 96.56, 98.82, 91.14, and 99.21 % on the entire database, and the expression, pose, and occlusion subsets, respectively. To the best of our knowledge, these are the best results reported so far on this database. Additionally, good generalization ability is also exhibited by the experiments on the FRGC v2.0 database.

3D Face Recognition Method Based on the Local Binary Pattern from Vertical and Horizontal on the Mesh

3D face recognition using local binary patterns

3-D Face Recognition Using Elbp-Based Facial Description and Local Feature Hybrid Matching

Towards 3d Face Recognition in the Real: A Registration-Free Approach Using Fine-Grained Matching of 3d Keypoint Descriptors

3D Face Recognition Based on Local/Global Shape Description

3D face recognition based on keypoints and local feature

3D Facial Expression Recognition Based on Combination of Local Features and Globe Information

Robust 3D Face Recognition by Local Shape Difference Boosting

A 3d Face Recognition Method Using Region-Based Extended Local Binary Pattern

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

3D Face Recognition Based on Local Descriptor

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

A new scheme for 3D face recognition based on 2D Gabor Wavelet Transform plus LBP

3D face recognition using distinctiveness enhanced facial representations and local feature hybrid matching

An Efficient 3D Face Recognition Approach Based on the Fusion of Novel Local Low-Level Features

3D Facial Expression Recognition Algorithm Using Local Threshold Binary Pattern and Histogram of Oriented Gradient

Mesh-Based Scale-Invariant Feature Transform-Like Method For Three-Dimensional Face Recognition Under Expressions And Missing Data

Fusing Hierarchical Multi-Scale Local Binary Patterns and Virtual Mirror Samples to Perform Face Recognition

EI3D: Expression-invariant 3D Face Recognition Based on Feature and Shape Matching

Automatic 3D facial expression recognition based on polytypic Local Binary Pattern