Abstract:Creating realistic animations of human faces with computer graphic models is still a challenging task. It is often solved either with tedious manual work or motion capture based techniques that require specialised and costly hardware. Example based animation approaches circumvent these problems by re-using captured data of real people. This data is split into short motion samples that can be looped or concatenated in order to create novel motion sequences. The obvious advantages of this approach are the simplicity of use and the high realism, since the data exhibits only real deformations. Rather than tuning weights of a complex face rig, the animation task is performed on a higher level by arranging typical motion samples in a way such that the desired facial performance is achieved. Two difficulties with example based approaches, however, are high memory requirements as well as the creation of artefact-free and realistic transitions between motion samples. We solve these problems by combining the realism and simplicity of example-based animations with the advantages of neural face models. Our neural face model is capable of synthesising high quality 3D face geometry and texture according to a compact latent parameter vector. This latent representation reduces memory requirements by a factor of 100 and helps creating seamless transitions between concatenated motion samples. In this paper, we present a marker-less approach for facial motion capture based on multi-view video. Based on the captured data, we learn a neural representation of facial expressions, which is used to seamlessly concatenate facial performances during the animation procedure. We demonstrate the effectiveness of our approach by synthesising mouthings for Swiss-German sign language based on viseme query sequences.

Modeling short-term dynamics and variability for realistic interactive facial animation

Interactive Facial-Geometric-Feature Animation For Generating Expressions Of Novel Faces

Facial Expression Animation Based on Physical Model

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Video-based Facial Animation Techniques

Video-driven state-aware facial animation

Video Tracked Facial Expression Animation

High Resolution Acquisition, Learning And Transfer Of Dynamic 3-D Facial Expressions

Real-Time Cleaning and Refinement of Facial Animation Signals

Interactive Animation of Virtual Characters: Application to Virtual Kung-Fu Fighting

Intuitive Facial Animation Editing Based On A Generative RNN Framework

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Individual facial image synthesis system for a virtual human

Personalized Multi-View Face Animation with Lifelike Textures

A Robust Interactive Facial Animation Editing System

Editing and Synthesis of 3D Facial Animation by Motion Propagation and Isomap Analysis

Individual Face Expressions and Expression Cloning

Neural Face Models for Example-Based Visual Speech Synthesis

Expressive facial animation synthesis by learning speech coarticulation and expression spaces

Real-Time 2.5D Facial Cartoon Animation Based on Pose and Expression Estimation

Video-Driven Neural Physically-Based Facial Asset for Production