Abstract:A novel framework for appearance-based photorealistic facial modeling, called Merging Face (M-Face), is presented and applied to generate emotional facial attributes in rotated views. Assuming that human faces belong to both the linear object class and the Lambertian object class, we span the face space and attribute space, respectively, by using groups of prototypes and merging ratio image (MRI). The MRI is defined as the seamless blend of individual expression ratio image, aging ratio image, and illumination ratio image (quotient image). The M-Face integrates the view space projection, shape caricaturing, and texture MRI-mapping techniques. Derived from the average face, the caricatured shape is reshaped to be more distinct by exaggerating individual distinctiveness, while the rerendered texture multiplies the MRI information during the caricaturing. Based on the M-Face model, the expression morphing, chronological aging or rejuvenating, and illumination variance can be merged seamlessly in a photorealistic style on desired view-rotated faces yielded by view morphing. This framework has the following advantages. First, 3-D reconstruction is avoided without weakening photorealistic effects. Second, the integration of shape caricaturing and texture MRI-mapping proves by experiments to be an efficient and computational inexpensive strategy for realistic face synthesis. Finally, the M-Face is a 2-D parameter-driven model, which highly simplifies user manipulations. The potential applications of M-Face are in various fields like virtual human face, speech-driven talking head, digital painting, film-making, and low-bit-rate communication

An Efficient Approach for Multi-View Face Animation Based on Quasi 3d Model

Personalized Multi-View Face Animation with Lifelike Textures

Automatic 3D Face Modeling Using 2D Active Appearance Models

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Animating Cartoon Faces by Multi-View Drawings

A Piece-Wise Learning Approach To 3d Facial Animation

Quasi-Facial Communication for Online Learning Using 3D Modeling Techniques.

Video Tracked Facial Expression Animation

Disentangling 3D/4D Facial Affect Recognition with Faster Multi-View Transformer

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Realization of 3-D Facial Animation Based on MPEG-4

Animate3D: Animating Any 3D Model with Multi-view Video Diffusion

Realistic 3D Facial Animations with Partial Expression Ratio Image

Three-dimensional Animated Face Modeling from Stereo Video

Triangular Patch Based Texture Fusion for Multi-view 3D Face Model

Personalized facial animation based on 3d model fitting from two orthogonal face images

Automatic Face Modeling and Synthesis Based on Image Pairs

M-Face: an Appearance-Based Photorealistic Model for Multiple Facial Attributes Rendering

IMAGE-BASED MULTI-VIEW 3D FACE GENERATION

Multi-view face alignment using 3D shape model for view estimation

Realistic 3d Facial Animations With Subtle Texture Changes