Abstract:In 3D face recognition, most work utilizes the rigid parts of face surfaces for matching to exclude the distortion caused by expressions. However, across a broad range of expressions, the rigid parts may not always be uniform and cover large parts of faces. On the other hand, the non-rigid regions of face surfaces also contain useful information for recognition. In this paper, we include the non-rigid regions besides the rigid parts for 3D face recognition. A deformation model is proposed to deform the non-rigid regions to the shapes that are more similar between intra-personal samples but less similar between inter-personal samples. Together with the rigid regions, the deformed parts make samples more discriminable so that the effect of expressions is reduced. The first part of our model uses the target gradient fields from enrolled samples to depress the distortion of the non-rigid regions. The gradient field works in the differential domain. According to the Poisson equation, a smooth deformed shape can be computed by a linear system. The second part of the model is the definition of a surface property that determines the deformation ability of different face regions. Unlike the target gradient fields that improve the similarity of intra-personal samples, the original topology and surface property can keep inter-personal samples sufficiently dissimilar. Our deformation model can be used to improve existing 3D face recognition methods. Experiments are carried out on FRGC and BU-3DFE databases. There are about 8–10% improvements obtained after applying this deformation model to the baseline ICP method. Compared with other deformation models, the experimental results show that our model has advantages on both recognition performance and computational efficiency.

On the consistency of Fréchet means in deformable models for curve and image analysis

Curvature-Driven Conformal Deformations

Differential Geometry for Model Independent Analysis of Images and Other Non-Euclidean Data: Recent Developments

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Revisiting the Fréchet distance between piecewise smooth curves

Curvelet Regularized Nonlinear Anisotropic Diffusion

An Improved Error Evaluation in One-Dimensional Deformation Measurements by Linear Digital Image Correlation

The moving frame on the fractal curves

Uniform Consistency of Generalized Fréchet Means

Wasserstein $F$-tests and Confidence Bands for the Frèchet Regression of Density Response Curves

Elastic analysis of irregularly or sparsely sampled curves

Discrete Curve Model for Non-Elastic Shape Analysis on Shape Manifold

Inference on subspheres model for directional data

A Lower Bound for Estimating Fréchet Means

The stochastic renormalized mean curvature flow for planar convex sets

Discrete Conformal Deformation: Algorithm and Experiments

The fshape framework for the variability analysis of functional shapes

Deformation of Framed Curves

Convex generalized Fréchet means in a metric tree

Random action of compact Lie groups and minimax estimation of a mean pattern

Convergent stochastic Expectation Maximization algorithm with efficient sampling in high dimension. Application to deformable template model estimation