Abstract:We present ShaDDR, an example-based deep generative neural network which produces a high-resolution textured 3D shape through geometry detailization and conditional texture generation applied to an input coarse voxel shape. Trained on a small set of detailed and textured exemplar shapes, our method learns to detailize the geometry via multi-resolution voxel upsampling and generate textures on voxel surfaces via differentiable rendering against exemplar texture images from a few views. The generation is interactive, taking less than 1 second to produce a 3D model with voxel resolutions up to 512^3. The generated shape preserves the overall structure of the input coarse voxel model, while the style of the generated geometric details and textures can be manipulated through learned latent codes. In the experiments, we show that our method can generate higher-resolution shapes with plausible and improved geometric details and clean textures compared to prior works. Furthermore, we showcase the ability of our method to learn geometric details and textures from shapes reconstructed from real-world photos. In addition, we have developed an interactive modeling application to demonstrate the generalizability of our method to various user inputs and the controllability it offers, allowing users to interactively sculpt a coarse voxel shape to define the overall structure of the detailized 3D shape. Code and data are available at <a class="link-external link-https" href="https://github.com/qiminchen/ShaDDR" rel="external noopener nofollow">this https URL</a>.

An Automatic Texture Generation Algorithm for 3D Shapes Based on Cgan

SDF-based 3D Generative Adversarial Networks for Image and Geometry Generation

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes

Texturify: Generating Textures on 3D Shape Surfaces

GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images

XDGAN: Multi-Modal 3D Shape Generation in 2D Space

GET3D--: Learning GET3D from Unconstrained Image Collections

3DTextureTransformer: Geometry Aware Texture Generation for Arbitrary Mesh Topology

Make-A-Texture: Fast Shape-Aware Texture Generation in 3 Seconds

Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement

Skin Textural Generation Via Blue-noise Gabor Filtering Based Generative Adversarial Network.

TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling

Fine Detailed Texture Learning for 3D Meshes with Generative Models

Texture Representation via Analysis and Synthesis with Generative Adversarial Networks

Geometry Sampling for 3D Face Generation Via DCGAN

Conditional Generative ConvNets for Exemplar-Based Texture Synthesis

ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Rendering

Hyper-3DG: Text-to-3D Gaussian Generation via Hypergraph

3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network

An Improved Genetic Algorithm for Three-Dimensional Reconstruction from a Single Uniform Texture Image.