Abstract:A point cloud is a simple and concise 3D representation, but point cloud generation is a long-term challenging task in 3D vision. However, most existing methods only focus on their effectiveness of generation and auto-encoding separately. Furthermore, both generative adversarial networks (GANs) and auto-encoders (AEs) are the most popular generative models. But there is a lack of related research that investigates the implicit connections between them in the field of point cloud generation. Thus, we propose a new bidirectional network (BI-Net) trained with collaborative learning, introducing more priors through the alternate parameter optimizations of a GAN and AE combination, which is different from the way of combining them at the network structure and loss function level. Specifically, BI-Net acts as a GAN and AE in different data processing directions, where their network structures can be reused. If optimizing only the GAN without the AE, there is no direct constraint of ground truth on the generator's parameter optimization. This unique approach enables better network optimization and leads to superior generation results. Moreover, we propose a nearest neighbor mutual exclusion (NNME) loss to further homogenize the spatial distribution of generated points during the reverse direction. Extensive experiments were conducted, and the results show that the BI-Net produces competitive and high-quality results on reasonable structure and uniform distributions compared to existing state-of-the-art methods. We believe that our network structure (BI-Net) with collaborative learning could provide a new promising method for future point cloud generation tasks.

DualGenerator: Information Interaction-based Generative Network for Point Cloud Completion

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Point Cloud Completion Cascade Optimization Network Based on Feature Fusion

Dual adversarial model: Exploring low-dimensional space features for point clouds generating and completing

Adaptive Recurrent Forward Network for Dense Point Cloud Completion

Dual Distribution Matching GAN

DPR-GAN: Dual-Stream Progressive Refinement for Adversarial 3D Point Cloud Generation

Unsupervised Point Cloud Completion and Segmentation by Generative Adversarial Autoencoding Network

2D-3DMatchingNet: Multimodal Point Completion with 2D Geometry Matching

Sequence Generation Completion Method and Resolution Scaling Network for Point Cloud Completion

Learning Geometric Transformation for Point Cloud Completion

Research on Multi-modal Point Cloud Completion Task

Multistage Adaptive Point-Growth Network for Dense Point Cloud Completion

SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generator

Completing Partial Point Clouds with Outliers by Collaborative Completion and Segmentation

N-DPC: Dense 3D Point Cloud Completion Based on Improved Multi-Stage Network

DuInNet: Dual-Modality Feature Interaction for Point Cloud Completion

Multimodal Shape Completion Via Conditional Generative Adversarial Networks

3D Point Cloud Shape Generation with Collaborative Learning of Generative Adversarial Network and Auto-Encoder

AGFA-Net: Adaptive Global Feature Augmentation Network for Point Cloud Completion

Point Cloud Completion via Multi-Scale Edge Convolution and Attention