Abstract:In the theory of differential geometry, surface normal, as a first order surface differential quantity, determines the orientation of a surface at each point and contains informative local surface shape information. To fully exploit this kind of information for 3D face recognition (FR), this paper proposes a novel highly discriminative facial shape descriptor, namely multi-scale and multi-component local normal patterns (MSMC-LNP). Given a normalized facial range image, three components of normal vectors are first estimated, leading to three normal component images. Then, each normal component image is encoded locally to local normal patterns (LNP) on different scales. To utilize spatial information of facial shape, each normal component image is divided into several patches, and their LNP histograms are computed and concatenated according to the facial configuration. Finally, each original facial surface is represented by a set of LNP histograms including both global and local cues. Moreover, to make the proposed solution robust to the variations of facial expressions, we propose to learn the weight of each local patch on a given encoding scale and normal component image. Based on the learned weights and the weighted LNP histograms, we formulate a weighted sparse representation-based classifier (W-SRC). In contrast to the overwhelming majority of 3D FR approaches which were only benchmarked on the FRGC v2.0 database, we carried out extensive experiments on the FRGC v2.0, Bosphorus, BU-3DFE and 3D-TEC databases, thus including 3D face data captured in different scenarios through various sensors and depicting in particular different challenges with respect to facial expressions. The experimental results show that the proposed approach consistently achieves competitive rank-one recognition rates on these databases despite their heterogeneous nature, and thereby demonstrates its effectiveness and its generalizability.

Oriented Gradient Maps Based Automatic Asymmetric 3D-2D Face Recognition

Automatic Asymmetric 3D-2D Face Recognition

Asymmetric 3D/2D Face Recognition Based on LBP Facial Representation and Canonical Correlation Analysis

Robust 3D Face Recognition by Local Shape Difference Boosting

3-D Face Recognition Using Elbp-Based Facial Description and Local Feature Hybrid Matching

2D Representation of Facial Surfaces for Multi-Pose 3D Face Recognition.

A Method Based on Geometric Invariant Feature for 3D Face Recognition

Benchmarking asymmetric 3D-2D face recognition systems

Robust Feature Extracted by the Generalized Optimal Discriminant Vectors for Face Recognition

Facial Ethnicity Classification Based on Boosted Local Texture and Shape Descriptions

3D face recognition based on multiple keypoint descriptors and sparse representation.

An efficient 3D face recognition approach using local geometrical signatures

3D Face Recognition using Mapped Depth Images

3D face recognition using distinctiveness enhanced facial representations and local feature hybrid matching

Fully automatic 3D facial expression recognition using differential mean curvature maps and histograms of oriented gradients

Multi-pose 3D Face Recognition Based on 2D Sparse Representation

A Novel Geometric Facial Representation Based on Multi-Scale Extended Local Binary Patterns

2D-3D Heterogeneous Face Recognition Based on Deep Coupled Spectral Regression

Towards 3d Face Recognition in the Real: A Registration-Free Approach Using Fine-Grained Matching of 3d Keypoint Descriptors

Mixed 2D-3D information for face recognition

Expression-Robust 3d Face Recognition Via Weighted Sparse Representation of Multi-Scale and Multi-Component Local Normal Patterns