Abstract:Facial expression plays an important role in face-to-face human-computer communication. Although considerable efforts have been made to enable computers to speak like human beings, how to express the rich semantic information through facial expression still remains a challenging problem. In this paper, we use the concept of “modality” to describe the semantic information which is related to the mood, attitude and intention. We propose a novel parametric mapping model to quantitatively characterize the non-verbal modality semantics for facial expression animation. In particular, seven-dimensional semantic parameters (SP) are first defined to describe the modality information. Then, a set of motion patterns represented with Key FAP (KFAP) is used to explore the correlations of MPEG-4 facial animation parameters (FAP). The SP-KFAP mapping model is trained with the linear regression algorithm (AMMSE) and an artificial neural network (ANN) respectively. Empirical analysis on a public facial image dataset verifies the strong correlation between the SP and KFAP. We further apply the mapping model to two different applications: facial expression synthesis and modality semantics detection from facial images. Both objective and subjective experimental results on the public datasets show the effectiveness of the proposed model. The results also indicate that the ANN method can significantly improve the prediction accuracies in both applications.

Researching Eye Expression Animation Using Compliant Spatial Mechanism Model

Design and Kinematic Analysis of a Novel Humanoid Robot Eye Using Pneumatic Artificial Muscles

Facial Expression Animation Based on Physical Model

Design Of A 2pam-1m Driven Robot Eye

Research on 3D Facial Expression Simulation Technology

Video Tracked Facial Expression Animation

Editing and Synthesis of 3D Facial Animation by Motion Propagation and Isomap Analysis

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Animating Cartoon Faces by Multi-View Drawings

Modeling the Correlation Between Modality Semantics and Facial Expressions

Dental care before lung transplantation: are we being too rigorous?

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Video-Based Facial Animation with Detailed Appearance Texture

Research on Facial Action Model for Human-like Agent

3D Motion Simulation of a Humanoid Robot Face

A Piece-Wise Learning Approach To 3d Facial Animation

Realistic 3d Facial Animations With Subtle Texture Changes

3D Facial Animation from Chinese Text.

Realistic 3D Facial Animations with Partial Expression Ratio Image

Physically-Based Facial Modeling and Animation with Unity3D Game Engine

Personalized Multi-View Face Animation with Lifelike Textures