Abstract:In the field of deep learning, the generative model did not attract much attention until GANs (generative adversarial networks) appeared. In 2014, Google’s Ian Goodfellow proposed a generative model called GANs. GANs use different structures and objective functions from the existing generative model. For example, GANs use two neural networks: a generator that creates a realistic image, and a discriminator that distinguishes whether the input is real or synthetic. If there are no problems in the training process, GANs can generate images that are difficult even for experts to distinguish in terms of authenticity. Currently, GANs are the most researched subject in the field of computer vision, which deals with the technology of image style translation, synthesis, and generation, and various models have been unveiled. The issues raised are also improving one by one. In image synthesis, BEGAN (Boundary Equilibrium Generative Adversarial Network), which outperforms the previously announced GANs, learns the latent space of the image, while balancing the generator and discriminator. Nonetheless, BEGAN also has a mode collapse wherein the generator generates only a few images or a single one. Although BEGAN-CS (Boundary Equilibrium Generative Adversarial Network with Constrained Space), which was improved in terms of loss function, was introduced, it did not solve the mode collapse. The discriminator structure of BEGAN-CS is AE (AutoEncoder), which cannot create a particularly useful or structured latent space. Compression performance is not good either. In this paper, this characteristic of AE is considered to be related to the occurrence of mode collapse. Thus, we used VAE (Variational AutoEncoder), which added statistical techniques to AE. As a result of the experiment, the proposed model did not cause mode collapse but converged to a better state than BEGAN-CS.

CS-IntroVAE: Cauchy-Schwarz Divergence-Based Introspective Variational Autoencoder

AS-IntroVAE: Adversarial Similarity Distance Makes Robust IntroVAE

A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancy

eVAE: Evolutionary Variational Autoencoder

Regularizing Variational Autoencoder with Diversity and Uncertainty Awareness

Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Models

How to train your VAE

Unregularized Auto-Encoder with Generative Adversarial Networks for Image Generation

CVA2E: A Conditional Variational Autoencoder with an Adversarial Training Process for Hyperspectral Imagery Classification

BEGAN v3: Avoiding Mode Collapse in GANs Using Variational Inference

Hidden Talents of the Variational Autoencoder

Solving the Reconstruction-Generation Trade-Off: Generative Model with Implicit Embedding Learning

Variational Approaches for Auto-Encoding Generative Adversarial Networks

Prior Learning in Introspective VAEs

Comparative Analysis of Generative Models: Enhancing Image Synthesis with VAEs, GANs, and Stable Diffusion

Recurrent Variational Autoencoders for Learning Nonlinear Generative Models in the Presence of Outliers.

Wasserstein-Wasserstein Auto-Encoders

NVAE: A Deep Hierarchical Variational Autoencoder

VAE Learning via Stein Variational Gradient Descent

Multi-Stage Variational Auto-Encoders for Coarse-to-Fine Image Generation

A Survey on Variational Autoencoders from a Green AI Perspective