Shape and Expression Space of Realistic Human Faces

Yuru Pei,Hongbin Zha

DOI: https://doi.org/10.3321/j.issn:1003-9775.2006.05.001

2006-01-01

Abstract:We present a novel method to generate a parameterized space of human facial scans. Our approach is under an energy minimization frame. The optimization solves the displacement vector at each vertex on the base mesh. The error metrics include the following terms: distance, surface smoothness, and feature constraints including curves, boundaries and marker pairs. With the template fitting to static expression scans with the same algorithm, an expression space is generated as well. The feature curves are automatically extracted from expression maps with an edge detection algorithm. Such feature curves are used to reduce the dimensionality of the shape space. The consistent parameterization in neutral faces and expressions forms the basis of a large category of applications, e.g. shape morphing, texture transferring and expression transferring. In view of the similarity between feature curves on depth images and those on 2D line drawings of cartoons, the nonlinear optimization is employed to realize the dramatic expression transfer from cartoons onto realistic facial models.