Abstract:A point cloud is a simple and concise 3D representation, but point cloud generation is a long-term challenging task in 3D vision. However, most existing methods only focus on their effectiveness of generation and auto-encoding separately. Furthermore, both generative adversarial networks (GANs) and auto-encoders (AEs) are the most popular generative models. But there is a lack of related research that investigates the implicit connections between them in the field of point cloud generation. Thus, we propose a new bidirectional network (BI-Net) trained with collaborative learning, introducing more priors through the alternate parameter optimizations of a GAN and AE combination, which is different from the way of combining them at the network structure and loss function level. Specifically, BI-Net acts as a GAN and AE in different data processing directions, where their network structures can be reused. If optimizing only the GAN without the AE, there is no direct constraint of ground truth on the generator's parameter optimization. This unique approach enables better network optimization and leads to superior generation results. Moreover, we propose a nearest neighbor mutual exclusion (NNME) loss to further homogenize the spatial distribution of generated points during the reverse direction. Extensive experiments were conducted, and the results show that the BI-Net produces competitive and high-quality results on reasonable structure and uniform distributions compared to existing state-of-the-art methods. We believe that our network structure (BI-Net) with collaborative learning could provide a new promising method for future point cloud generation tasks.

PT2PC: Learning to Generate 3D Point Cloud Shapes from Part Tree Conditions

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

A Point Cloud Generative Model via Tree-Structured Graph Convolutions for 3D Brain Shape Reconstruction

Learning Part Generation and Assembly for Structure-aware Shape Synthesis

Progressive Multimodal Shape Generation via Contextual Part Reasoning

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

Patch-Wise Point Cloud Generation: A Divide-and-Conquer Approach

MRGAN: Multi-Rooted 3D Shape Generation with Unsupervised Part Disentanglement

Learning Progressive Point Embeddings for 3D Point Cloud Generation

TreePartNet

Generative 3D Part Assembly via Part-Whole-Hierarchy Message Passing

3D-aware Image Generation and Editing with Multi-modal Conditions

Constructing an Efficient and Adaptive Learning Model for 3D Object Generation

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

Learning Generalizable Part-based Feature Representation for 3D Point Clouds

Masked Generative Extractor for Synergistic Representation and 3D Generation of Point Clouds

Part-Aware Point Cloud Completion Through Multi-Modal Part Segmentation.

CC3D: Layout-Conditioned Generation of Compositional 3D Scenes

Image-based Tree Modeling.

3D Point Cloud Shape Generation with Collaborative Learning of Generative Adversarial Network and Auto-Encoder

Exploiting Topological Priors for Boosting Point Cloud Generation