Abstract:In the field of deep learning, the generative model did not attract much attention until GANs (generative adversarial networks) appeared. In 2014, Google’s Ian Goodfellow proposed a generative model called GANs. GANs use different structures and objective functions from the existing generative model. For example, GANs use two neural networks: a generator that creates a realistic image, and a discriminator that distinguishes whether the input is real or synthetic. If there are no problems in the training process, GANs can generate images that are difficult even for experts to distinguish in terms of authenticity. Currently, GANs are the most researched subject in the field of computer vision, which deals with the technology of image style translation, synthesis, and generation, and various models have been unveiled. The issues raised are also improving one by one. In image synthesis, BEGAN (Boundary Equilibrium Generative Adversarial Network), which outperforms the previously announced GANs, learns the latent space of the image, while balancing the generator and discriminator. Nonetheless, BEGAN also has a mode collapse wherein the generator generates only a few images or a single one. Although BEGAN-CS (Boundary Equilibrium Generative Adversarial Network with Constrained Space), which was improved in terms of loss function, was introduced, it did not solve the mode collapse. The discriminator structure of BEGAN-CS is AE (AutoEncoder), which cannot create a particularly useful or structured latent space. Compression performance is not good either. In this paper, this characteristic of AE is considered to be related to the occurrence of mode collapse. Thus, we used VAE (Variational AutoEncoder), which added statistical techniques to AE. As a result of the experiment, the proposed model did not cause mode collapse but converged to a better state than BEGAN-CS.

Convergence of Relativistic GANs With Zero-Centered Gradient Penalties

On Convergence and Stability of GANs

Towards the Gradient Vanishing, Divergence Mismatching and Mode Collapse of Generative Adversarial Nets

Which Training Methods for GANs do actually Converge?

Towards a Better Global Loss Landscape of GANs

Improving Generalization and Stability of Generative Adversarial Networks

Soft Generative Adversarial Network: Combating Mode Collapse in Generative Adversarial Network Training Via Dynamic Borderline Softening Mechanism

Convergence of Non-Convex Non-Concave GANs Using Sinkhorn Divergence

Regularization and Normalization for Generative Adversarial Networks: A Review

Towards a Better Understanding and Regularization of GAN Training Dynamics

Local Convergence of Gradient Descent-Ascent for Training Generative Adversarial Networks

GANs with Variational Entropy Regularizers: Applications in Mitigating the Mode-Collapse Issue

On the Convergence and Robustness of Training GANs with Regularized Optimal Transport

Convergence Problems with Generative Adversarial Networks (GANs)

The relativistic discriminator: a key element missing from standard GAN

Gradient descent GAN optimization is locally stable

Testing Generated Distributions in GANs to Penalize Mode Collapse.

BEGAN v3: Avoiding Mode Collapse in GANs Using Variational Inference

Convergence of GANs Training: A Game and Stochastic Control Methodology

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs Via Gradient Analysis.

Global Convergence to the Equilibrium of GANs using Variational Inequalities