Abstract:In the theory of differential geometry, surface normal, as a first order surface differential quantity, determines the orientation of a surface at each point and contains informative local surface shape information. To fully exploit this kind of information for 3D face recognition (FR), this paper proposes a novel highly discriminative facial shape descriptor, namely multi-scale and multi-component local normal patterns (MSMC-LNP). Given a normalized facial range image, three components of normal vectors are first estimated, leading to three normal component images. Then, each normal component image is encoded locally to local normal patterns (LNP) on different scales. To utilize spatial information of facial shape, each normal component image is divided into several patches, and their LNP histograms are computed and concatenated according to the facial configuration. Finally, each original facial surface is represented by a set of LNP histograms including both global and local cues. Moreover, to make the proposed solution robust to the variations of facial expressions, we propose to learn the weight of each local patch on a given encoding scale and normal component image. Based on the learned weights and the weighted LNP histograms, we formulate a weighted sparse representation-based classifier (W-SRC). In contrast to the overwhelming majority of 3D FR approaches which were only benchmarked on the FRGC v2.0 database, we carried out extensive experiments on the FRGC v2.0, Bosphorus, BU-3DFE and 3D-TEC databases, thus including 3D face data captured in different scenarios through various sensors and depicting in particular different challenges with respect to facial expressions. The experimental results show that the proposed approach consistently achieves competitive rank-one recognition rates on these databases despite their heterogeneous nature, and thereby demonstrates its effectiveness and its generalizability.

Benchmarking asymmetric 3D-2D face recognition systems

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Automatic Asymmetric 3D-2D Face Recognition

3D face recognition based on multiple keypoint descriptors and sparse representation.

3DMKDSRC: A novel approach for 3D face recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

3D Assisted Face Recognition Via Progressive Pose Estimation

Asymmetric 3D/2D Face Recognition Based on LBP Facial Representation and Canonical Correlation Analysis

Oriented Gradient Maps Based Automatic Asymmetric 3D-2D Face Recognition

3D aided face recognition across pose variations

An efficient 3D face recognition approach using local geometrical signatures

3-D Face Recognition Using Elbp-Based Facial Description and Local Feature Hybrid Matching

Learning the Spherical Harmonic Features for 3-D Face Recognition

Towards 3d Face Recognition in the Real: A Registration-Free Approach Using Fine-Grained Matching of 3d Keypoint Descriptors

Multi-pose 3D Face Recognition Based on 2D Sparse Representation

2D-3D Heterogeneous Face Recognition Based on Deep Canonical Correlation Analysis.

Minimizing Illumination Differences for 3D to 2D Face Recognition Using Lighting Maps.

A fast and robust 3D face recognition approach based on deeply learned face representation.

Expression-Robust 3d Face Recognition Via Weighted Sparse Representation of Multi-Scale and Multi-Component Local Normal Patterns

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction

2D Representation of Facial Surfaces for Multi-Pose 3D Face Recognition.