Abstract:Generative adversarial network has become the factual standard for high-quality image synthesis. However, modeling the distribution of complex datasets (e.g. ImageNet and COCO-Stuff) remains challenging in unsupervised approaches. This is partly due to the imbalance between the generator and the discriminator during training, the discriminator easily defeats the generator because of special views. In this paper, we propose a model called multi-scale conditional reconstruction GAN (MS-GAN). The core concept of MS-GAN is to model the local density implicitly using different scales of instance conditions. Instance conditions are extracted from the target images via a self-supervised learning model. In addition, we alignment the semantic features of the observed instances by adding an additional reconstruction loss to the generator. Our MS-GAN can aggregate instance features at different scales and maximize semantic features. This allows the generator to learn additional comparative knowledge from instance features, leading to a better feature representation, thus improving the performance of the generation task. Experimental results on the ImageNet dataset and the COCO-Stuff dataset show that our method matches or exceeds the original performance in both FID and IS scores compared to the IC-GAN framework. Additionally, our precision score on the ImageNet dataset improved from 74.2% to 79.9%.

3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network

SDF-based 3D Generative Adversarial Networks for Image and Geometry Generation

3D-Mask-GAN:Unsupervised Single-View 3D Object Reconstruction

Paired 3D Model Generation with Conditional Generative Adversarial Networks

Multi-Scale Conditional Reconstruction Generative Adversarial Network

Learning Adversarial 3D Model Generation with 2D Image Enhancer

Progressive Learning of 3D Reconstruction Network from 2D GAN Data

Semi-supervised Three-dimensional Reconstruction Framework with GAN.

Vsa-Cgan: An Intelligent Generation Model For Deep Learning Sample Database Construction

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

3D visualization model construction based on generative adversarial networks

2D GANs Meet Unsupervised Single-view 3D Reconstruction

Multi-view Learning and Reconstruction Algorithms via Generative Adversarial Networks

X-GANs: Image Reconstruction Made Easy for Extreme Cases

Using GAN to Augment the Synthesizing Images from 3D Models.

A Variational Autoencoder Cascade Generative Adversarial Network for Scalable 3D Object Generation and Reconstruction

Geometry aware 3D generation from in-the-wild images in ImageNet

3D Human Pose Estimation with Generative Adversarial Networks

3D-aware Image Generation and Editing with Multi-modal Conditions

An End-to-End Conditional Generative Adversarial Network Based on Depth Map for 3D Craniofacial Reconstruction

Conditional Image Generation Using Feature-Matching Gan