Abstract:Synthesis and re-targeting of facial expressions is central to facial animation and often involves significant manual work in order to achieve realistic expressions, due to the difficulty of capturing high quality dynamic expression data. In this paper we address fundamental issues regarding the use of high quality dense 3-D data samples undergoing motions at video speeds, e.g. human facial expressions. In order to utilize such data for motion analysis and re-targeting, correspondences must be established between data in different frames of the same faces as well as between different faces. We present a data driven approach that consists of four parts: 1) High speed, high accuracy capture of moving faces without the use of markers, 2) Very precise tracking of facial motion using a multi-resolution deformable mesh, 3) A unified low dimensional mapping of dynamic facial motion that can separate expression style, and 4) Synthesis of novel expressions as a combination of expression styles. The accuracy and resolution of our method allows us to capture and track subtle expression details. The low dimensional representation of motion data in a unified embedding for all the subjects in the database allows for learning the most discriminating characteristics of each individual's expressions as that person's "expression style". Thus new expressions can be synthesized, either as dynamic morphing between individuals, or as expression transfer from a source face to a target face, as demonstrated in a series of experiments.

A Survey of Computer Facial Animation Techniques

Video-based Facial Animation Techniques

Video-driven state-aware facial animation

Computer Vision and Machine Learning in 3D Human Animation: a Survey

Animating Cartoon Faces by Multi-View Drawings

Performance-Driven Animation of Hand-Drawn Cartoon Faces

4D facial analysis: A survey of datasets, algorithms and applications

Facial Expression Animation Based on Physical Model

Facial Feature Animation and Its Artistic Representation

Video Tracked Facial Expression Animation

Study of Face Modeling and Animation

Video-Based Facial Animation with Detailed Appearance Texture

Research on 3D Facial Expression Simulation Technology

A Piece-Wise Learning Approach To 3d Facial Animation

Physically-Based Facial Modeling and Animation with Unity3D Game Engine

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Face Animation Based on Large Audiovisual Database

Realization of 3-D Facial Animation Based on MPEG-4

Facial Feature Point Detection: A Comprehensive Survey

High Resolution Acquisition, Learning And Transfer Of Dynamic 3-D Facial Expressions

Survey: Parameterized 3d Human Body Modeling And Geometric Deformation Technology