Abstract:One important aspect of multimedia application scenarios is the ability to control the facial expressions of virtual characters. One popular solution is to retarget the expressions of actors to virtual characters. Traditional 3D facial expression retargeting algorithms are mostly based on the Blendshape model. However, excessive reliance on the Blendshape model introduces several limitations. For example, the quality of the base expressions has a large influence on the expression retargeting results, requires large amounts of 3D face data, and must be calibrated for each user. We propose a 3D facial expression retargeting framework based on an identity-independent expression feature vector (hereafter referred to as the expression vector). This expression vector, which is related only to facial expressions, is originally extracted from face images; then, the corresponding expressions are transferred to the target (which can be any 3D face model) using V2ENet, a generative adversarial network (GAN)-structured model. Our framework requires only the expression vector and a neutral 3D face model to achieve natural and vivid expression retargeting, and it does not rely on the Blendshape model. When using the expression vector obtained from a cognitive perspective, our method can also perform 3D expression retargeting at the cognitive level. A series of experiments demonstrates that our method not only provides a simplified expression retargeting process but also achieves a better effect than the deformation transfer algorithm. The proposed framework is suitable for a wide range of applications and also achieves good expression retargeting for cartoon-style face models.

Subtle Facial Expression Modeling With Vector Field Decomposition

Modeling Expressions of Peking Opera Facial Make-Ups

Modeling and Editing of Peking Opera Facial Makeup Expressions

Facial Expression Synthesis Based on Expressional Feature Space and Expression Decomposition

A vector resolution and composition algorithm of facial expression

Subtle Facial Expression Synthesis Using Motion Manifold Embedding and Nonlinear Decomposable Generative Models

Facial Expression Synthesis Based on Facial Expression Decomposition and Warping

Video Tracked Facial Expression Animation

A Facial Expression Model For Human-Like Agent

Facial Expression Animation Based on Physical Model

Facial Expression Synthesis Based on Facial Component Model.

Subtle expression recognition-a comprehensive approach

Extended facial expression synthesis using statistical appearance model

A Visualization Method of Facial Expression Deformation Based on Pore-Scale Facial Feature Matching

3D Facial Expression Retargeting Framework Based on an Identity-Independent Expression Feature Vector

Modeling the Correlation Between Modality Semantics and Facial Expressions

Facial Expression Recognition Based on Auxiliary Models

Support Vector Machine-Based Facial Expression Analysis

Synthesis of Combined Facial Expressions Using Anatomy-based Model

Facial Expression Using Adaptive Sublayer Compensation Based Feature Extraction

Research on Facial Expression Simulation Based on Depth Image