Abstract:Our cross‐parameterization method first segments characters and parameterizes them onto a multi‐sphere domain. Subsequently, we employ a hierarchical feature alignment method to match the corresponding deforming features. Our approach achieves high‐quality results in the applications of 3D morphing, texture transfer, character synthesis, and deformation transfer. The demand for immersive technology and realistic virtual environments has created a need for automated solutions to generate characters with morphological variations. However, existing approaches either rely on manual labour or oversimplify the problem by limiting it to static meshes or deformation transfers without shape morphing. In this paper, we propose a new cross‐parameterization approach that semi‐automates the generation of morphologically diverse characters with synthesized articulations and animations. The main contribution of this work is that our approach parameterizes deforming characters into a novel hierarchical multi‐sphere domain, while considering the attributes of mesh topology, deformation and animation. With such a multi‐sphere domain, our approach minimizes parametric distortion rates, enhances the bijectivity of parameterization and aligns deforming feature correspondences. The alignment process we propose allows users to focus only on major joint pairs, which is much simpler and more intuitive than the existing alignment solutions that involve a manual process of identifying feature points on mesh surfaces. Compared to recent works, our approach achieves high‐quality results in the applications of 3D morphing, texture transfer, character synthesis and deformation transfer.

Cross-Species 3D Face Morphing Via Alignment-Aware Controller

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Automatic 3D Face Modeling Using 2D Active Appearance Models

Conformal Surface Registration with Applications on Face Morphing

Conformal Surface Morphing with Applications on Facial Expressions

Progressive Face Dynamic Morphing

Face Alignment Across Large Poses: A 3D Solution

Hierarchical Spherical Cross‐Parameterization for Deforming Characters

ACE: Adversarial Correspondence Embedding for Cross Morphology Motion Retargeting from Human to Nonhuman Characters

Controllable high-fidelity facial performance transfer

Towards Accurate Facial Motion Retargeting with Identity-Consistent and Expression-Exclusive Constraints

Face Swapping under Large Pose Variations: A 3D Model Based Approach

Neuromuscular Control of the Face-Head-Neck Biomechanical Complex With Learning-Based Expression Transfer From Images and Videos

Transformer Based Multi-model Fusion for 3D Facial Animation

3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction

FaceController: Controllable Attribute Editing for Face in the Wild

Facial Expression Imitation Method for Humanoid Robot Based on Smooth-Constraint Reversed Mechanical Model (SRMM)

3 D Morphing for Triangle Meshes using Deformation Matrix

Correspondence attention for facial appearance simulation

An Automatic Method of Building 3D Morphable Face Model