Abstract:Transferring deformation from a source shape to a target shape is a very useful technique in computer graphics. State-of-the-art deformation transfer methods require either point-wise correspondences between source and target shapes, or pairs of deformed source and target shapes with corresponding deformations. However, in most cases, such correspondences are not available and cannot be reliably established using an automatic algorithm. Therefore, substantial user effort is needed to label the correspondences or to obtain and specify such shape sets. In this work, we propose a novel approach to automatic deformation transfer between two unpaired shape sets without correspondences. 3D deformation is represented in a high-dimensional space. To obtain a more compact and effective representation, two convolutional variational autoencoders are learned to encode source and target shapes to their latent spaces. We exploit a Generative Adversarial Network (GAN) to map deformed source shapes to deformed target shapes, both in the latent spaces, which ensures the obtained shapes from the mapping are indistinguishable from the target shapes. This is still an under-constrained problem, so we further utilize a reverse mapping from target shapes to source shapes and incorporate cycle consistency loss, i.e. applying both mappings should reverse to the input shape. This VAE-Cycle GAN (VC-GAN) architecture is used to build a reliable mapping between shape spaces. Finally, a similarity constraint is employed to ensure the mapping is consistent with visual similarity, achieved by learning a similarity neural network that takes the embedding vectors from the source and target latent spaces and predicts the light field distance between the corresponding shapes. Experimental results show that our fully automatic method is able to obtain high-quality deformation transfer results with unpaired data sets, comparable or better than existing methods where strict correspondences are required.

Shape embedding and retrieval in multi-flow deformation

Quantitative and Flexible 3D Shape Dataset Augmentation Via Latent Space Embedding and Deformation Learning

Hybrid Neural Diffeomorphic Flow for Shape Representation and Generation via Triplane

A Unified Feature Representation and Learning Framework for 3D Shape

What Matters for 3D Scene Flow Network.

STARFlow: Spatial Temporal Feature Re-embedding with Attentive Learning for Real-world Scene Flow

Local Deep Feature Learning Framework for 3D Shape.

SSRFlow: Semantic-aware Fusion with Spatial Temporal Re-embedding for Real-world Scene Flow

Learning a discriminative deformation-invariant 3D shape descriptor via many-to-one encoder.

Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow

Bi-PointFlowNet: Bidirectional Learning for Point Cloud Based Scene Flow Estimation

Shape-Constraint Recurrent Flow for 6D Object Pose Estimation

Automatic Unpaired Shape Deformation Transfer

Deformation-driven Shape Correspondence Via Shape Recognition

Sketch-Based 3D Shape Retrieval with Multi-View Fusion Transformer

DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval

Learning Geodesics of Geometric Shape Deformations From Images

Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects

LATFormer: Locality-Aware Point-View Fusion Transformer for 3D shape recognition

Shared Latent Membership Enables Joint Shape Abstraction and Segmentation With Deformable Superquadrics