Abstract:Significant interest and progress have been drawn to the recent advancements in image creation using deep generative model, but the field of automatic three-dimensional shape creation is largely under-developed and inspires a great deal of research activity across a wide variety of disciplines. We add a new kind of previously named variational mixture of posteriors into the adversarial network using geometric data described as volumetric grids. Our main contribution is the introduction of a new type of prior called variational mixture of posteriors prior into the adversarial network, dubbed VampPrior-3DGAN , in a mathematic principled way. Specifically, we leverage an encoder as a regularizer to penalize missing modes, while introduce a variational mixture of posterior prior as the latent variable distribution of GAN to dynamically and adaptively update its prior distribution. The key intuition behind this architecture is that the latent variables should retain information about the data to minimize the undue impact of the prior assumptions. This seemingly simple modification to the GAN framework is surprisingly effective and results in models which enable diversity in generated samples, although trained with limited data. Realistic 3D objects can be easily generated by sampling the VampPrior-3DGAN's latent probabilistic manifold. For validation, we apply our method on tasks from the fields of three-dimensional volumetric generation, reconstruction from a single RGB image and partial shape completion from a single perspective view, and show that it is on par with or outperforms the state-of-the-art approaches, both quantitatively and qualitatively.

Twin-Channel Gan: Repair Shape with Twin-Channel Generative Adversarial Network and Structural Constraints

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

SDF-based 3D Generative Adversarial Networks for Image and Geometry Generation

Shape Inpainting using 3D Generative Adversarial Network and Recurrent Convolutional Networks

Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANs

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Learning Adversarial 3D Model Generation with 2D Image Enhancer

Multi-View Consistent Generative Adversarial Networks for 3D-Aware Image Synthesis

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

Shape generation via learning an adaptive multimodal prior

SAGNet:Structure-aware Generative Network for 3D-Shape Modeling

Multi-task Generative Adversarial Learning on Geometrical Shape Reconstruction from EEG Brain Signals

Synthesizing 3D Shapes From Silhouette Image Collections Using Multi-Projection Generative Adversarial Networks

XDGAN: Multi-Modal 3D Shape Generation in 2D Space

Shape related constraints aware generation of Mechanical Designs through Deep Convolutional GAN

Learning Part Generation and Assembly for Structure-aware Shape Synthesis

Component-aware Generative Autoencoder for Structure Hybrid and Shape Completion

Deep Structured Generative Models.

Learning to Generate 3D Shapes from a Single Example

Unsupervised 3D Shape Completion through GAN Inversion

DuoLift-GAN:Reconstructing CT from Single-view and Biplanar X-Rays with Generative Adversarial Networks