Abstract:In this paper, we propose the Soft Generative Adversarial Network (SoftGAN), a strategy that utilizes a dynamic borderline softening mechanism to train Generative Adversarial Networks. This mechanism aims to solve the mode collapse problem and enhance the training stability of the generated outputs. Within the SoftGAN, the objective of the discriminator is to learn a fuzzy concept of real data with a soft borderline between real and generated data. This objective is achieved by balancing the principles of maximum concept coverage and maximum expected entropy of fuzzy concepts. During the early training stage of the SoftGAN, the principle of maximum expected entropy of fuzzy concepts guides the learning process due to the significant divergence between the generated and real data. However, in the final stage of training, the principle of maximum concept coverage dominates as the divergence between the two distributions decreases. The dynamic borderline softening mechanism of the SoftGAN can be likened to a student (the generator) striving to create realistic images, with the tutor (the discriminator) dynamically guiding the student towards the right direction and motivating effective learning. The tutor gives appropriate encouragement or requirements according to abilities of the student at different stages, so as to promote the student to improve themselves better. Our approach offers both theoretical and practical benefits for improving GAN training. We empirically demonstrate the superiority of our SoftGAN approach in addressing mode collapse issues and generating high-quality outputs compared to existing approaches.

Improved Generative Adversarial Networks with Reconstruction Loss

Generative Adversarial Networks Based on Denoising and Reconstruction Regularization

Soft Generative Adversarial Network: Combating Mode Collapse in Generative Adversarial Network Training Via Dynamic Borderline Softening Mechanism

MCGAN: Enhancing GAN Training with Regression-Based Generator Loss

Optimizing Generative Adversarial Networks in Latent Space

Super-resolution Reconstruction of Image Based on Generative Adversarial Network with Attention Module

Simple Yet Effective Way for Improving the Performance of GAN

Towards the Gradient Vanishing, Divergence Mismatching and Mode Collapse of Generative Adversarial Nets

Enhanced Evolutionary Generative Adversarial Networks

Improving GAN Training via Binarized Representation Entropy (BRE) Regularization

Mode Regularized Generative Adversarial Networks

GEGAN: Generative Adversarial Networks Training Based on Gradient Directed Evolutionary Strategy

Support Matching: A Novel Regularization To Escape From Mode Collapse In Gans

Improved Generative Adversarial Network Learning Via Structural Pattern Classification

Single Frame Image Super-Resolution Reconstruction Based on Improved Generative Adversarial Network

Improved Training of Generative Adversarial Networks Using Representative Features

Improving MMD-GAN Training with Repulsive Loss Function

Antimode collapse generative adversarial networks

Improving GAN with Neighbors Embedding and Gradient Matching

Generative Adversarial Networks with Learnable Auxiliary Module for Image Synthesis

A Super-Resolution Generative Adversarial Network with Simplified Gradient Penalty and Relativistic Discriminator