Abstract:A point cloud is a simple and concise 3D representation, but point cloud generation is a long-term challenging task in 3D vision. However, most existing methods only focus on their effectiveness of generation and auto-encoding separately. Furthermore, both generative adversarial networks (GANs) and auto-encoders (AEs) are the most popular generative models. But there is a lack of related research that investigates the implicit connections between them in the field of point cloud generation. Thus, we propose a new bidirectional network (BI-Net) trained with collaborative learning, introducing more priors through the alternate parameter optimizations of a GAN and AE combination, which is different from the way of combining them at the network structure and loss function level. Specifically, BI-Net acts as a GAN and AE in different data processing directions, where their network structures can be reused. If optimizing only the GAN without the AE, there is no direct constraint of ground truth on the generator's parameter optimization. This unique approach enables better network optimization and leads to superior generation results. Moreover, we propose a nearest neighbor mutual exclusion (NNME) loss to further homogenize the spatial distribution of generated points during the reverse direction. Extensive experiments were conducted, and the results show that the BI-Net produces competitive and high-quality results on reasonable structure and uniform distributions compared to existing state-of-the-art methods. We believe that our network structure (BI-Net) with collaborative learning could provide a new promising method for future point cloud generation tasks.

Generative AI for 3-D Point Clouds

Learning Representations and Generative Models for 3D Point Clouds

Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era

Learning Progressive Point Embeddings for 3D Point Cloud Generation

Point-E: A System for Generating 3D Point Clouds from Complex Prompts

Generative AI for Visualization: Opportunities and Challenges

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

Progress and Prospects in 3D Generative AI: A Technical Overview including 3D human

AI Horizons: Unveiling the Future of Generative Intelligence

Procedural Content Generation via Generative Artificial Intelligence

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

DeepCloud. The Application of a Data-driven, Generative Model in Design

Point Cloud Generation Using Deep Adversarial Local Features for Augmented and Mixed Reality Contents

3D Point Cloud Shape Generation with Collaborative Learning of Generative Adversarial Network and Auto-Encoder

Challenges and Opportunities in 3D Content Generation

Enhancing Reality: Exploring the Potential of Generative Artificial Intelligence

Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction

Deep Generative Models on 3D Representations: A Survey

Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification

PointInverter: Point Cloud Reconstruction and Editing via a Generative Model with Shape Priors