Abstract:In the field of deep learning, the generative model did not attract much attention until GANs (generative adversarial networks) appeared. In 2014, Google’s Ian Goodfellow proposed a generative model called GANs. GANs use different structures and objective functions from the existing generative model. For example, GANs use two neural networks: a generator that creates a realistic image, and a discriminator that distinguishes whether the input is real or synthetic. If there are no problems in the training process, GANs can generate images that are difficult even for experts to distinguish in terms of authenticity. Currently, GANs are the most researched subject in the field of computer vision, which deals with the technology of image style translation, synthesis, and generation, and various models have been unveiled. The issues raised are also improving one by one. In image synthesis, BEGAN (Boundary Equilibrium Generative Adversarial Network), which outperforms the previously announced GANs, learns the latent space of the image, while balancing the generator and discriminator. Nonetheless, BEGAN also has a mode collapse wherein the generator generates only a few images or a single one. Although BEGAN-CS (Boundary Equilibrium Generative Adversarial Network with Constrained Space), which was improved in terms of loss function, was introduced, it did not solve the mode collapse. The discriminator structure of BEGAN-CS is AE (AutoEncoder), which cannot create a particularly useful or structured latent space. Compression performance is not good either. In this paper, this characteristic of AE is considered to be related to the occurrence of mode collapse. Thus, we used VAE (Variational AutoEncoder), which added statistical techniques to AE. As a result of the experiment, the proposed model did not cause mode collapse but converged to a better state than BEGAN-CS.

InvertGAN: Reducing Mode Collapse with Multi-Dimensional Gaussian Inversion

The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks

Soft Generative Adversarial Network: Combating Mode Collapse in Generative Adversarial Network Training Via Dynamic Borderline Softening Mechanism

Study of Prevention of Mode Collapse in Generative Adversarial Network (GAN)

DynGAN: Solving Mode Collapse in GANs with Dynamic Clustering

VirtualGAN: Reducing Mode Collapse in Generative Adversarial Networks Using Virtual Mapping

Combating Mode Collapse via Offline Manifold Entropy Estimation

BourGAN: Generative Networks with Metric Embeddings

VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning

Reducing Mode Collapse With Monge–Kantorovich Optimal Transport for Generative Adversarial Networks

On Mode Collapse in Generative Adversarial Networks

Tackling mode collapse in multi-generator GANs with orthogonal vectors

IID-GAN: an IID Sampling Perspective for Regularizing Mode Collapse

Towards the Gradient Vanishing, Divergence Mismatching and Mode Collapse of Generative Adversarial Nets

Distribution constraining for combating mode collapse in generative adversarial networks

Combating Mode Collapse in GANs via Manifold Entropy Estimation

Antimode collapse generative adversarial networks

BEGAN v3: Avoiding Mode Collapse in GANs Using Variational Inference