Abstract:The generative adversarial network (GAN) has recently emerged as a promising generative model. Its application in the image field has been extensive, but there has been little research concerning point clouds.The combination of a GAN and a graph convolutional network has been the state-of-the-art method for generating point clouds. However, there is a significant gap between the generated point cloud and the point cloud used for training. In order to improve the quality of the generated point cloud, this study proposed multi-scale gradient point GAN (MSG-Point-GAN). The training of the GAN is a dynamic game process, and we expected the generation and discrimination capabilities to be symmetric, so that the network training would be more stable. Based on the concept of progressive growth, this method used the network structure of a multi-scale gradient GAN (MSG-GAN) to stabilize the training process. The discriminator of this method used part of the PointNet structure to resolve the problem of the disorder and rotation of the point cloud. The discriminator could effectively determine the authenticity of the generated point cloud. This study also analyzed the optimization process of the objective function of the MSG-Point-GAN. The experimental results showed that the training process of the MSG-Point-GAN was stable, and the point cloud quality was superior to other methods in subjective vision. From the perspective of performance metrics, the gap between the point cloud generated by the proposed method and the real point cloud was significantly smaller than that generated by other methods. Based on the practical analysis, the point cloud generated by the proposed method for training the point-cloud classification network was improved by about 0.2%, as compared to the original network. The proposed method provided a stable training framework for point cloud generation. It can effectively promote the development of point-cloud-generation technology.

MPR-GAN: A Novel Neural Rendering Framework for MLS Point Cloud With Deep Generative Learning

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

Point-Based Neural Scene Rendering for Street Views

MSG-Point-GAN: Multi-Scale Gradient Point GAN for Point Cloud Generation

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

DPR-GAN: Dual-Stream Progressive Refinement for Adversarial 3D Point Cloud Generation

Neural Point Cloud Rendering via Multi-Plane Projection

Low Latency Point Cloud Rendering with Learned Splatting

RealPoint3D: Generating 3D Point Clouds from a Single Image of Complex Scenarios.

Point Cloud Generation Using Deep Adversarial Local Features for Augmented and Mixed Reality Contents

MS-GAN: multi-scale GAN with parallel class activation maps for image reconstruction

PBR-GAN: Imitating Physically-Based Rendering with Generative Adversarial Networks

A GMM Based Algorithm To Generate Point-Cloud And Its Application To Neuroimaging

Multiscale Representation for Real-Time Anti-Aliasing Neural Rendering

Research on 3D Visualization of Drone Scenes Based on Neural Radiance Fields

What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANs

GaussianPU: A Hybrid 2D-3D Upsampling Framework for Enhancing Color Point Clouds via 3D Gaussian Splatting

Point2Pix: Photo-Realistic Point Cloud Rendering via Neural Radiance Fields

Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting

MRRA-GAN: Multi-Resolution Relation-Aware GAN for Point Cloud Completion.

Point Encoder GAN: A Deep Learning Model for 3D Point Cloud Inpainting.