Abstract:The generative adversarial network (GAN) has recently emerged as a promising generative model. Its application in the image field has been extensive, but there has been little research concerning point clouds.The combination of a GAN and a graph convolutional network has been the state-of-the-art method for generating point clouds. However, there is a significant gap between the generated point cloud and the point cloud used for training. In order to improve the quality of the generated point cloud, this study proposed multi-scale gradient point GAN (MSG-Point-GAN). The training of the GAN is a dynamic game process, and we expected the generation and discrimination capabilities to be symmetric, so that the network training would be more stable. Based on the concept of progressive growth, this method used the network structure of a multi-scale gradient GAN (MSG-GAN) to stabilize the training process. The discriminator of this method used part of the PointNet structure to resolve the problem of the disorder and rotation of the point cloud. The discriminator could effectively determine the authenticity of the generated point cloud. This study also analyzed the optimization process of the objective function of the MSG-Point-GAN. The experimental results showed that the training process of the MSG-Point-GAN was stable, and the point cloud quality was superior to other methods in subjective vision. From the perspective of performance metrics, the gap between the point cloud generated by the proposed method and the real point cloud was significantly smaller than that generated by other methods. Based on the practical analysis, the point cloud generated by the proposed method for training the point-cloud classification network was improved by about 0.2%, as compared to the original network. The proposed method provided a stable training framework for point cloud generation. It can effectively promote the development of point-cloud-generation technology.

MSG-Voxel-GAN: Multi-Scale Gradient Voxel GAN for 3D Object Generation

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

MSG-Point-GAN: Multi-Scale Gradient Point GAN for Point Cloud Generation

Multi-class GAN for generating multi-class images in object recognition

A Variational Autoencoder Cascade Generative Adversarial Network for Scalable 3D Object Generation and Reconstruction

A Multi-Scale Generative Adversarial Network for Real-World Image Denoising

3DMGNet: 3D Model Generation Network Based on Multi-Modal Data Constraints and Multi-Level Feature Fusion

Learning spectral normalized adversarial systems with stacked structure for high-quality 3D object generation

AVFP-MVX: Multimodal VoxelNet with Attention Mechanism and Voxel Feature Pyramid

Neural Volumetric Mesh Generator

Learning Adversarial 3D Model Generation with 2D Image Enhancer

Learning Effective NeRFs and SDFs Representations with 3D Generative Adversarial Networks for 3D Object Generation: Technical Report for ICCV 2023 OmniObject3D Challenge

Voxel-based three-view hybrid parallel network for 3D object classification

3D generation on ImageNet

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars

3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network

GET3DGS: Generate 3D Gaussians Based on Points Deformation Fields

SSP-GAN:Spectral Normalization Sphere-Guided 3D Point Cloud Generation

Generative and Discriminative Voxel Modeling with Convolutional Neural Networks

Constructing an Efficient and Adaptive Learning Model for 3D Object Generation