Abstract:In 3D face recognition, most work utilizes the rigid parts of face surfaces for matching to exclude the distortion caused by expressions. However, across a broad range of expressions, the rigid parts may not always be uniform and cover large parts of faces. On the other hand, the non-rigid regions of face surfaces also contain useful information for recognition. In this paper, we include the non-rigid regions besides the rigid parts for 3D face recognition. A deformation model is proposed to deform the non-rigid regions to the shapes that are more similar between intra-personal samples but less similar between inter-personal samples. Together with the rigid regions, the deformed parts make samples more discriminable so that the effect of expressions is reduced. The first part of our model uses the target gradient fields from enrolled samples to depress the distortion of the non-rigid regions. The gradient field works in the differential domain. According to the Poisson equation, a smooth deformed shape can be computed by a linear system. The second part of the model is the definition of a surface property that determines the deformation ability of different face regions. Unlike the target gradient fields that improve the similarity of intra-personal samples, the original topology and surface property can keep inter-personal samples sufficiently dissimilar. Our deformation model can be used to improve existing 3D face recognition methods. Experiments are carried out on FRGC and BU-3DFE databases. There are about 8–10% improvements obtained after applying this deformation model to the baseline ICP method. Compared with other deformation models, the experimental results show that our model has advantages on both recognition performance and computational efficiency.

Facial Expression Generation Based on NURBS Warping and Single Perspective Images

GPU-Accelerated Parallel Realistic 3D Facial Expression Synthesis

Modeling Expressions of Peking Opera Facial Make-Ups

An efficient algorithm of facial expression generation based on RBF network

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Personalized 3-D facial expression synthesis based on landmark constraint.

Facial Expression Synthesis Based on Facial Expression Decomposition and Warping

Fast face modeling based on features and flexible mesh model

Video Tracked Facial Expression Animation

Facial Expression Animation Based on Physical Model

Realistic Reconstruction of Human Face Based on Images

GENERATION OF REALISTIC 3-D SPECIFIC HUMAN FACE

Replacement of Facial Parts in Images.

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Shape and Expression Space of Realistic Human Faces

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

“Edutainment 2017” a Visual and Semantic Representation of 3D Face Model for Reshaping Face in Images

Geometrical Consistency Modeling on B-Spline Parameter Domain for 3D Face Reconstruction From Limited Number of Wild Images

3D Facial Modeling for Animation: A Nonlinear Approach

B-spline Shape from Motion & Shading: An Automatic Free-form Surface Modeling for Face Reconstruction

Personalized Multi-View Face Animation with Lifelike Textures