Abstract:The generative adversarial network (GAN) has recently emerged as a promising generative model. Its application in the image field has been extensive, but there has been little research concerning point clouds.The combination of a GAN and a graph convolutional network has been the state-of-the-art method for generating point clouds. However, there is a significant gap between the generated point cloud and the point cloud used for training. In order to improve the quality of the generated point cloud, this study proposed multi-scale gradient point GAN (MSG-Point-GAN). The training of the GAN is a dynamic game process, and we expected the generation and discrimination capabilities to be symmetric, so that the network training would be more stable. Based on the concept of progressive growth, this method used the network structure of a multi-scale gradient GAN (MSG-GAN) to stabilize the training process. The discriminator of this method used part of the PointNet structure to resolve the problem of the disorder and rotation of the point cloud. The discriminator could effectively determine the authenticity of the generated point cloud. This study also analyzed the optimization process of the objective function of the MSG-Point-GAN. The experimental results showed that the training process of the MSG-Point-GAN was stable, and the point cloud quality was superior to other methods in subjective vision. From the perspective of performance metrics, the gap between the point cloud generated by the proposed method and the real point cloud was significantly smaller than that generated by other methods. Based on the practical analysis, the point cloud generated by the proposed method for training the point-cloud classification network was improved by about 0.2%, as compared to the original network. The proposed method provided a stable training framework for point cloud generation. It can effectively promote the development of point-cloud-generation technology.

DPR-GAN: Dual-Stream Progressive Refinement for Adversarial 3D Point Cloud Generation

SDF-based 3D Generative Adversarial Networks for Image and Geometry Generation

SpatialGAN: Progressive Image Generation Based on Spatial Recursive Adversarial Expansion

Learning Progressive Point Embeddings for 3D Point Cloud Generation

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

MSG-Point-GAN: Multi-Scale Gradient Point GAN for Point Cloud Generation

Progressive Point Cloud Deconvolution Generation Network

Dual adversarial model: Exploring low-dimensional space features for point clouds generating and completing

DualGenerator: Information Interaction-based Generative Network for Point Cloud Completion

Point Cloud Generation Using Deep Adversarial Local Features for Augmented and Mixed Reality Contents

3D Point Cloud Shape Generation with Collaborative Learning of Generative Adversarial Network and Auto-Encoder

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

PU-GAN: a Point Cloud Upsampling Adversarial Network

MPR-GAN: A Novel Neural Rendering Framework for MLS Point Cloud With Deep Generative Learning

CPCGAN: A Controllable 3D Point Cloud Generative Adversarial Network with Semantic Label Generating

Progressive Learning of 3D Reconstruction Network from 2D GAN Data

PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling

Point AE-DCGAN: A Deep Learning Model for 3D Point Cloud Lossy Geometry Compression.

Point-StyleGAN: Multi-scale Point Cloud Synthesis with Style Modulation

Exploiting Topological Priors for Boosting Point Cloud Generation

PCAC-GAN: A Sparse-Tensor-Based Generative Adversarial Network for 3D Point Cloud Attribute Compression