Abstract:Featured Application This concise is a novel training methodology for GANs with strong generalization ability, speed the training up, and less prone to mode collapse. Generative Adversarial Networks (GANs) are powerful generative models for numerous tasks and datasets. However, most of the existing models suffer from mode collapse. The most recent research indicates that the reason for it is that the optimal transportation map from random noise to the data distribution is discontinuous, but deep neural networks (DNNs) can only approximate continuous ones. Instead, the latent representation is a better raw material used to construct a transportation map point to the data distribution than random noise. Because it is a low-dimensional mapping related to the data distribution, the construction procedure seems more like expansion rather than starting all over. Besides, we can also search for more transportation maps in this way with smoother transformation. Thus, we have proposed a new training methodology for GANs in this paper to search for more transportation maps and speed the training up, named Express Construction. The key idea is to train GANs with two independent phases for successively yielding latent representation and data distribution. To this end, an Auto-Encoder is trained to map the real data into the latent space, and two couples of generators and discriminators are used to produce them. To the best of our knowledge, we are the first to decompose the training procedure of GAN models into two more uncomplicated phases, thus tackling the mode collapse problem without much more computational cost. We also provide theoretical steps toward understanding the training dynamics of this procedure and prove assumptions. No extra hyper-parameters have been used in the proposed method, which indicates that Express Construction can be used to train any GAN models. Extensive experiments are conducted to verify the performance of realistic image generation and the resistance to mode collapse. The results show that the proposed method is lightweight, effective, and less prone to mode collapse.

SCGN: novel generative model using the convergence of latent space by training

SpatialGAN: Progressive Image Generation Based on Spatial Recursive Adversarial Expansion

BEGAN v3: Avoiding Mode Collapse in GANs Using Variational Inference

Towards the Gradient Vanishing, Divergence Mismatching and Mode Collapse of Generative Adversarial Nets

SGAN: An Alternative Training of Generative Adversarial Networks

Soft Generative Adversarial Network: Combating Mode Collapse in Generative Adversarial Network Training Via Dynamic Borderline Softening Mechanism

CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training

Sketch-then-Edit Generative Adversarial Network

VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning

Improving GAN with Neighbors Embedding and Gradient Matching

Solving the Reconstruction-Generation Trade-Off: Generative Model with Implicit Embedding Learning

A Novel Conditional Medical Image Generation GAN with Latent Space Optimal Transport

SCGAN: Semi-Centralized Generative Adversarial Network for Image Generation in Distributed Scenes

Sub-Gan: An Unsupervised Generative Model Via Subspaces

Self Sparse Generative Adversarial Networks

Kolmogorov-Smirnov GAN

Improvement and Application of Generative Adversarial Networks Algorithm Based on Transfer Learning

Virtual Conditional Generative Adversarial Networks

Self-Conditioned Generative Adversarial Networks for Image Editing

Express Construction for GANs from Latent Representation to Data Distribution

ContraNeRF: 3D-Aware Generative Model via Contrastive Learning with Unsupervised Implicit Pose Embedding