Abstract:3D shape generation, vital in fields including computer graphics, industrial design, and robotics, has seen a significant growth due to deep learning advancements. Nevertheless, a prevailing challenge in this area lies in its heavy reliance on extensive data for training. Consequently, the ability to generate 3D shapes with a limited quantity of training samples emerges as a desirable objective. The aim of this research is to design deep generative models capable of learning from a single reference 3D shape, thereby eliminating the requirement for sizeable datasets. Drawing inspiration from contemporary Generative Adversarial Networks (GANs) that operate on individual 3D shapes in a coarse-to-fine manner hierarchically, we propose a novel wavelet-based framework for single 3D shape generation, which preserves the global shape structure whilst inducing local variability. Our key observation is that, through wavelet decomposition, the low-frequency components of two inputs, where one input is a corrupted version of the other, are very similar. This similarity enables reconstruction of the uncorrupted input by leveraging the low-frequency components of the corrupted version. This observation motivates us to propose the wavelet decomposition of the 2D tri-plane feature maps of a given 3D shape, followed by the synthesis of new tri-plane feature maps for shape generation. To the best of our knowledge, this work represents the first endeavor to incorporate wavelet analysis into a deep generative model for the purpose of generating novel 3D shapes with a single example. Furthermore, we adapt data augmentation and Coulomb adversarial generative loss to facilitate training and generation procedures. We demonstrate the effectiveness of our approach by generating diverse 3D shapes and conducting quantitative comparisons with established baseline methods. Our implementation is available at https://github.com/hhuang-code/SinWavelet.

Learning Energy-Based 3D Descriptor Networks for Volumetric Shape Synthesis and Analysis

Learning Descriptor Networks for 3D Shape Synthesis and Analysis

Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis

Networks for 3 D Shape Synthesis and Analysis

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

SDF-based 3D Generative Adversarial Networks for Image and Geometry Generation

3D-A-Nets: 3D Deep Dense Descriptor for Volumetric Shapes with Adversarial Networks

Learning Discriminative and Generative Shape Embeddings for Three-Dimensional Shape Retrieval

3D ShapeNets: A Deep Representation for Volumetric Shapes

Learning Adversarial 3D Model Generation with 2D Image Enhancer

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

A survey of deep learning-based 3D shape generation

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

3D Shape Retrieval Based on Laplace Operator and Joint Bayesian Model

Shape generation via learning an adaptive multimodal prior

Progressive Shape-Distribution-Encoder for Learning 3D Shape Representation

DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval

A Single 3D Shape Wavelet-Based Generative Model

Dual octree graph networks for learning adaptive volumetric shape representations

Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition.

Deep Generative Models on 3D Representations: A Survey