Abstract:Establishing a dense vertex-to-vertex anthropometric correspondence between 3D faces is an important and fundamental problem in 3D face research, which can contribute to most applications of 3D faces. This paper proposes a sparse facial deformable model to automatically achieve this task. For an input 3D face, the basic idea is to generate a new 3D face that has the same mesh topology as a reference face and the highly similar shape to the input face, and whose vertices correspond to those of the reference face in an anthropometric sense. Two constraints: 1) the shape constraint and 2) correspondence constraint are modeled in our method to satisfy the three requirements. The shape constraint is solved by a novel face deformation approach in which a normal-ray scheme is integrated to the closest-vertex scheme to keep high-curvature shapes in deformation. The correspondence constraint is based on an assumption that if the vertices on 3D faces are corresponded, their shape signals lie on a manifold and each face signal can be represented sparsely by a few typical items in a dictionary. The dictionary can be well learnt and contains the distribution information of the corresponded vertices. The correspondence information can be conveyed to the sparse representation of the generated 3D face. Thus, a patch-based sparse representation is proposed as the correspondence constraint. By solving the correspondence constraint iteratively, the vertices of the generated face can be adjusted to correspondence positions gradually. At the early iteration steps, smaller sparsity thresholds are set that yield larger representation errors but better globally corresponded vertices. At the later steps, relatively larger sparsity thresholds are used to encode local shapes. By this method, the vertices in the new face approach the right positions progressively until the final global correspondence is reached. Our method is automatic, and the manual work is needed only in training procedure. The experimental results on a large-scale publicly available 3D face data set, BU-3DFE, demonstrate that our method achieves better performance than existing methods.

3D facial correspondence based on deformation and geodesic distance consistency constraint

3D Facial Correspondence Based on Regional Deformation and Multi-Scale Constraint

Hierarchical correspondence of 3D faces based on thin plate spline deformation (HCTD)

Hierarchical Point Correspondence Method of 3D Facial Skin Based on Thin Plate Spline Deformation

Establishing Point Correspondence of 3D Faces Via Sparse Facial Deformable Model

A Hierarchical 3D Facial Correspondence Method Based on Regional Deformation and Multi-Constraint

A Correspondence Method of 3D Facial Points Based on Voxel Model and Multi-scale Constraints

The Correction Of The Distortion Of Human Face Based On Three-Dimensional Modeling Methods

A Corresponding Method of 3D Skull Feature Points Based on Voxel Models and Multi-Geometric Feature Constraint

Establishing Dense Correspondence of High Resolution 3 D Faces Via Möbius Transformations

Find Dense Correspondence between High Resolution Non-rigid 3D Human Faces.

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Non-Rigid Point Cloud Matching Based on Invariant Structure for Face Deformation

Local craniofacial morphological relationship modeling based on physiologi-cal registration of vertices.

3D Craniofacial Registration Using Thin-Plate Spline Transform and Cylindrical Surface Projection.

An Automatic Multi-Sample 3d Face Registration Method Based on Thin Plate Spline and Deformable Model

Facial Augmented Reality based on Hierarchical Optimization of Similarity Aspect Graph

A Hierarchical Dense Deformable Model for 3D Face Reconstruction from Skull.

An Automatic Non-rigid Point Matching Method for Dense 3D Face Scans

3D Face Similarity Measure by Fréchet Distances of Geodesics

3D Facial Similarity Measure Based on Geodesic Network and Curvatures