Abstract:A point cloud is a simple and concise 3D representation, but point cloud generation is a long-term challenging task in 3D vision. However, most existing methods only focus on their effectiveness of generation and auto-encoding separately. Furthermore, both generative adversarial networks (GANs) and auto-encoders (AEs) are the most popular generative models. But there is a lack of related research that investigates the implicit connections between them in the field of point cloud generation. Thus, we propose a new bidirectional network (BI-Net) trained with collaborative learning, introducing more priors through the alternate parameter optimizations of a GAN and AE combination, which is different from the way of combining them at the network structure and loss function level. Specifically, BI-Net acts as a GAN and AE in different data processing directions, where their network structures can be reused. If optimizing only the GAN without the AE, there is no direct constraint of ground truth on the generator's parameter optimization. This unique approach enables better network optimization and leads to superior generation results. Moreover, we propose a nearest neighbor mutual exclusion (NNME) loss to further homogenize the spatial distribution of generated points during the reverse direction. Extensive experiments were conducted, and the results show that the BI-Net produces competitive and high-quality results on reasonable structure and uniform distributions compared to existing state-of-the-art methods. We believe that our network structure (BI-Net) with collaborative learning could provide a new promising method for future point cloud generation tasks.

Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification

A Hybrid Generative and Discriminative PointNet on Unordered Point Sets

Learning Progressive Point Embeddings for 3D Point Cloud Generation

Masked Generative Extractor for Synergistic Representation and 3D Generation of Point Clouds

Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis

3D Point Cloud Shape Generation with Collaborative Learning of Generative Adversarial Network and Auto-Encoder

Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

An 3D Point Cloud Reconstruction Approach from Single Image for Smart Power Plant

BiPointNet: Binary Neural Network for Point Clouds

Patch-Wise Point Cloud Generation: A Divide-and-Conquer Approach

Learning Representations and Generative Models for 3D Point Clouds

Wavelet transform-assisted generative model for efficient 3d deep shape generation

CGNet: A Cascaded Generative Network for dense point cloud reconstruction from a single image

Transformer-based Point Cloud Generation Network

GenReg: Deep Generative Method for Fast Point Cloud Registration

Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Models

Single View Point Cloud Generation via Unified 3D Prototype

PointInverter: Point Cloud Reconstruction and Editing via a Generative Model with Shape Priors

Spiking PointNet: Spiking Neural Networks for Point Clouds

StarNet: Style-Aware 3D Point Cloud Generation