Abstract:To synthesize real-time and realistic facial animation, we present an effective algorithm which combines image- and geometry-based methods for facial animation simulation. Considering the numerous motion units in the expression coding system, we present a novel simplified motion unit based on the basic facial expression, and construct the corresponding basic action for a head model. As image features are difficult to obtain using the performance driven method, we develop an automatic image feature recognition method based on statistical learning, and an expression image semi-automatic labeling method with rotation invariant face detection, which can improve the accuracy and efficiency of expression feature identification and training. After facial animation redirection, each basic action weight needs to be computed and mapped automatically. We apply the blend shape method to construct and train the corresponding expression database according to each basic action, and adopt the least squares method to compute the corresponding control parameters for facial animation. Moreover, there is a pre-integration of diffuse light distribution and specular light distribution based on the physical method, to improve the plausibility and efficiency of facial rendering. Our work provides a simplification of the facial motion unit, an optimization of the statistical training process and recognition process for facial animation, solves the expression parameters, and simulates the subsurface scattering effect in real time. Experimental results indicate that our method is effective and efficient, and suitable for computer animation and interactive applications.

Facial Feature Animation and Its Artistic Representation

Interactive Facial-Geometric-Feature Animation For Generating Expressions Of Novel Faces

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Facial Expression Animation Based on Physical Model

Video-driven state-aware facial animation

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Facial Sketch Rendering and Animation for Fun Communications.

Facial Animation Based on Feature Points

Video Tracked Facial Expression Animation

Video-based Facial Animation Techniques

Animating Cartoon Faces by Multi-View Drawings

Research on Facial Expression Simulation Based on Depth Image

Specific Face Model and Expression Animation Model Based on Physical Model

A Method for Deforming-Driven Exaggerated Facial Animation Generation

Realistic Tree-Dimensional Facial Expression Synthesis

High Resolution Acquisition, Learning And Transfer Of Dynamic 3-D Facial Expressions

A Survey of Facial Expression Generation Techniques Based on the Study Method

Synthesis of Combined Facial Expressions Using Anatomy-based Model

Statistical learning based facial animation

Example-based performance driven facial shape animation

A Generic Framework for Efficient 2-D and 3-D Facial Expression Analogy.