Abstract:With the rising popularity of virtual worlds, the importance of data-driven parametric models of 3D meshes has grown rapidly. Numerous applications, such as computer vision, procedural generation, and mesh editing, vastly rely on these models. However, current approaches do not allow for independent editing of deformations at different frequency levels. They also do not benefit from representing deformations at different frequencies with dedicated representations, which would better expose their properties and improve the generated meshes' geometric and perceptual quality. In this work, spectral meshes are introduced as a method to decompose mesh deformations into low-frequency and high-frequency deformations. These features of low- and high-frequency deformations are used for representation learning with graph convolutional networks. A parametric model for 3D facial mesh synthesis is built upon the proposed framework, exposing user parameters that control disentangled high- and low-frequency deformations. Independent control of deformations at different frequencies and generation of plausible synthetic examples are mutually exclusive objectives. A Conditioning Factor is introduced to leverage these objectives. Our model takes further advantage of spectral partitioning by representing different frequency levels with disparate, more suitable representations. Low frequencies are represented with standardised Euclidean coordinates, and high frequencies with a normalised deformation representation (DR). This paper investigates applications of our proposed approach in mesh reconstruction, mesh interpolation, and multi-frequency editing. It is demonstrated that our method improves the overall quality of generated meshes on most datasets when considering both the L1 norm and perceptual Dihedral Angle Mesh Error (DAME) metrics.

Multi-curve Spectrum Representation of Facial Movements and Expressions

Tongue Movements and Mouth Expressions Animation Based on Multi-curve Spectrum

MPEG-4 Parameter Computing with Multi-curve Spectrum of Eyes

Video Tracked Facial Expression Animation

Modeling Expressions of Peking Opera Facial Make-Ups

Facial Expression Animation Based on Physical Model

Anatomy-Based Modeling, Muscle-Based Animating and Math-Based Representing of Human Eyes

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Simulation Method of Eye Movements and Expressions

Animating Cartoon Faces by Multi-View Drawings

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

High Resolution Acquisition, Learning And Transfer Of Dynamic 3-D Facial Expressions

3D Motion Simulation of a Humanoid Robot Face

Expressive 3D face synthesis by multi-space modeling

Fast face modeling based on features and flexible mesh model

A Facial Expression Model For Human-Like Agent

Research on 3D Facial Expression Simulation Technology

An Efficient Approach for Multi-View Face Animation Based on Quasi 3d Model

Physically-Based Facial Modeling and Animation with Unity3D Game Engine

Deep Spectral Meshes: Multi-Frequency Facial Mesh Processing with Graph Neural Networks

Facial Expression Mapping Based on Elastic and Muscle-Distribution-Based Models