Abstract:In 3D face recognition, most work utilizes the rigid parts of face surfaces for matching to exclude the distortion caused by expressions. However, across a broad range of expressions, the rigid parts may not always be uniform and cover large parts of faces. On the other hand, the non-rigid regions of face surfaces also contain useful information for recognition. In this paper, we include the non-rigid regions besides the rigid parts for 3D face recognition. A deformation model is proposed to deform the non-rigid regions to the shapes that are more similar between intra-personal samples but less similar between inter-personal samples. Together with the rigid regions, the deformed parts make samples more discriminable so that the effect of expressions is reduced. The first part of our model uses the target gradient fields from enrolled samples to depress the distortion of the non-rigid regions. The gradient field works in the differential domain. According to the Poisson equation, a smooth deformed shape can be computed by a linear system. The second part of the model is the definition of a surface property that determines the deformation ability of different face regions. Unlike the target gradient fields that improve the similarity of intra-personal samples, the original topology and surface property can keep inter-personal samples sufficiently dissimilar. Our deformation model can be used to improve existing 3D face recognition methods. Experiments are carried out on FRGC and BU-3DFE databases. There are about 8–10% improvements obtained after applying this deformation model to the baseline ICP method. Compared with other deformation models, the experimental results show that our model has advantages on both recognition performance and computational efficiency.

Fast Non-Negative Tensor Factorization based on CP decomposition for 3D Facial Expression Recognition

Nonnegative Tensor Factorization Based on Low-Rank Subspace for Facial Expression Recognition

Sparse and Low-rank Tucker Decomposition with Its Application to 2D+3D Facial Expression Recognition

Sparse Orthogonal Tucker Decomposition for 2D+3D Facial Expression Recognition

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Coseparable Nonnegative Tensor Factorization With T-CUR Decomposition

A modified non-negative Matrix Factorization algorithm for face recognition

Two-dimensional non-negative matrix factorization for face representation and recognition

Sparse Non-negative Matrix Factorization Based on Spatial Pyramid Matching for Face Recognition

Graph Regularized Discriminative Non-Negative Matrix Factorization for Face Recognition

Large Margin Based Nonnegative Matrix Factorization and Partial Least Squares Regression for Face Recognition

Face Recognition Using Fisher Non-Negative Matrix Factorization With Sparseness Constraints

Feature Level Analysis for 3D Facial Expression Recognition.

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Towards Reading Beyond Faces for Sparsity-aware 3D/4D Affect Recognition

Nonnegative Matrix Factorization with Toeplitz Penalty

Transductive Nonnegative Matrix Tri-Factorization.

Wavelet-based Non-negative Matrix Factorization with Sparseness Constraints for Face Recognition

Jointly Optimizing Expressional and Residual Models for 3D Facial Expression Removal.