Abstract:Synthesis and re-targeting of facial expressions is central to facial animation and often involves significant manual work in order to achieve realistic expressions, due to the difficulty of capturing high quality dynamic expression data. In this paper we address fundamental issues regarding the use of high quality dense 3-D data samples undergoing motions at video speeds, e.g. human facial expressions. In order to utilize such data for motion analysis and re-targeting, correspondences must be established between data in different frames of the same faces as well as between different faces. We present a data driven approach that consists of four parts: 1) High speed, high accuracy capture of moving faces without the use of markers, 2) Very precise tracking of facial motion using a multi-resolution deformable mesh, 3) A unified low dimensional mapping of dynamic facial motion that can separate expression style, and 4) Synthesis of novel expressions as a combination of expression styles. The accuracy and resolution of our method allows us to capture and track subtle expression details. The low dimensional representation of motion data in a unified embedding for all the subjects in the database allows for learning the most discriminating characteristics of each individual's expressions as that person's "expression style". Thus new expressions can be synthesized, either as dynamic morphing between individuals, or as expression transfer from a source face to a target face, as demonstrated in a series of experiments.

Facial Expression Transformation, Aging and Invisible View Reconstruction (1)

Facial Expression Transformation, Aging and Invisible View Reconstruction (2)

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Video-Based Facial Animation with Detailed Appearance Texture

Facial Expression Animation Based on Physical Model

Example Based Facial Aging Simulation Via Facial Detail Transfer.

Simulation of Aging Effects in Face Images

Video-based Facial Animation Techniques

Replacement of Facial Parts in Images.

Synthesis of 3D Aging Faces Based on Color Gabor Wavelet and Texture Transplant

Video Tracked Facial Expression Animation

Face Aging Effect Simulation Using Hidden Factor Analysis Joint Sparse Representation

A Heterogeneous Image Transformation Based Synthesis Framework For Face Sketch Aging

Facetransfer: A System Model Of Facial Image Rendering

Facial Aging Simulation via Tensor Completion.

Three DimensionaI FaciaI Expression Synthesis Based on a SingIe Photo

Age Synthesis and Estimation via Faces: A Survey

A Realistic Dynamic Facial Expression Transfer Method

High Resolution Acquisition, Learning And Transfer Of Dynamic 3-D Facial Expressions

A Multi-Resolution Dynamic Model for Face Aging Simulation

A Survey of Facial Expression Generation Techniques Based on the Study Method