Abstract:One important aspect of multimedia application scenarios is the ability to control the facial expressions of virtual characters. One popular solution is to retarget the expressions of actors to virtual characters. Traditional 3D facial expression retargeting algorithms are mostly based on the Blendshape model. However, excessive reliance on the Blendshape model introduces several limitations. For example, the quality of the base expressions has a large influence on the expression retargeting results, requires large amounts of 3D face data, and must be calibrated for each user. We propose a 3D facial expression retargeting framework based on an identity-independent expression feature vector (hereafter referred to as the expression vector). This expression vector, which is related only to facial expressions, is originally extracted from face images; then, the corresponding expressions are transferred to the target (which can be any 3D face model) using V2ENet, a generative adversarial network (GAN)-structured model. Our framework requires only the expression vector and a neutral 3D face model to achieve natural and vivid expression retargeting, and it does not rely on the Blendshape model. When using the expression vector obtained from a cognitive perspective, our method can also perform 3D expression retargeting at the cognitive level. A series of experiments demonstrates that our method not only provides a simplified expression retargeting process but also achieves a better effect than the deformation transfer algorithm. The proposed framework is suitable for a wide range of applications and also achieves good expression retargeting for cartoon-style face models.

Performance-Driven Two-Dimensional Vector Expression Animation

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Animating Cartoon Faces by Multi-View Drawings

Sketch Based Multi-source 3D Animation Transfer

Video Tracked Facial Expression Animation

Example-based performance driven facial shape animation

Data-Driven Motion Exaggeration

Real-Time 2.5D Facial Cartoon Animation Based on Pose and Expression Estimation

Interactive Facial-Geometric-Feature Animation For Generating Expressions Of Novel Faces

Research on Facial Expression Simulation Based on Depth Image

Expression-Driven Sketch Animation

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

3D Facial Expression Retargeting Framework Based on an Identity-Independent Expression Feature Vector

Facial Expression Animation Based on Physical Model

Facial Expression Retargeting from Human to Avatar Made Easy

Facial Animation Based on Feature Points

A Generic Framework for Efficient 2-D and 3-D Facial Expression Analogy.

Real-Time 3d Facial Expression Control Based on Performance

Edge Feature Values in the Tracking Depiction of Facial Expression

Expression Transfer for Facial Sketch Animation

Data-Driven Approach to Synthesizing Facial Animation Using Motion Capture