Abstract:Facial expression plays an important role in face-to-face human-computer communication. Although considerable efforts have been made to enable computers to speak like human beings, how to express the rich semantic information through facial expression still remains a challenging problem. In this paper, we use the concept of “modality” to describe the semantic information which is related to the mood, attitude and intention. We propose a novel parametric mapping model to quantitatively characterize the non-verbal modality semantics for facial expression animation. In particular, seven-dimensional semantic parameters (SP) are first defined to describe the modality information. Then, a set of motion patterns represented with Key FAP (KFAP) is used to explore the correlations of MPEG-4 facial animation parameters (FAP). The SP-KFAP mapping model is trained with the linear regression algorithm (AMMSE) and an artificial neural network (ANN) respectively. Empirical analysis on a public facial image dataset verifies the strong correlation between the SP and KFAP. We further apply the mapping model to two different applications: facial expression synthesis and modality semantics detection from facial images. Both objective and subjective experimental results on the public datasets show the effectiveness of the proposed model. The results also indicate that the ANN method can significantly improve the prediction accuracies in both applications.

Eye Expression Animation Based on Compliant Spatial Mechanisms Model

Design and Kinematic Analysis of a Novel Humanoid Robot Eye Using Pneumatic Artificial Muscles

Facial Expression Animation Based on Physical Model

Video Tracked Facial Expression Animation

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Animating Cartoon Faces by Multi-View Drawings

3D Motion Simulation of a Humanoid Robot Face

Research on 3D Facial Expression Simulation Technology

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Video-Based Facial Animation with Detailed Appearance Texture

Editing and Synthesis of 3D Facial Animation by Motion Propagation and Isomap Analysis

Dental care before lung transplantation: are we being too rigorous?

Personalized Multi-View Face Animation with Lifelike Textures

A Facial Expression Model For Human-Like Agent

A Piece-Wise Learning Approach To 3d Facial Animation

Physically-Based Facial Modeling and Animation with Unity3D Game Engine

Expressive 3D face synthesis by multi-space modeling

Research on Facial Action Model for Human-like Agent

3D Facial Animation from Chinese Text.

Facial Expression Mapping Based on Elastic and Muscle-Distribution-Based Models

Modeling the Correlation Between Modality Semantics and Facial Expressions