Abstract:In this paper, we introduce DuelGAN, a generative adversarial network (GAN) solution to improve the stability of the generated samples and to mitigate mode collapse. Built upon the Vanilla GAN's two-player game between the discriminator $D_1$ and the generator $G$, we introduce a peer discriminator $D_2$ to the min-max game. Similar to previous work using two discriminators, the first role of both $D_1$, $D_2$ is to distinguish between generated samples and real ones, while the generator tries to generate high-quality samples which are able to fool both discriminators. Different from existing methods, we introduce another game between $D_1$ and $D_2$ to discourage their agreement and therefore increase the level of diversity of the generated samples. This property alleviates the issue of early mode collapse by preventing $D_1$ and $D_2$ from converging too fast. We provide theoretical analysis for the equilibrium of the min-max game formed among $G, D_1, D_2$. We offer convergence behavior of DuelGAN as well as stability of the min-max game. It's worth mentioning that DuelGAN operates in the unsupervised setting, and the duel between $D_1$ and $D_2$ does not need any label supervision. Experiments results on a synthetic dataset and on real-world image datasets (MNIST, Fashion MNIST, CIFAR-10, STL-10, CelebA, VGG, and FFHQ) demonstrate that DuelGAN outperforms competitive baseline work in generating diverse and high-quality samples, while only introduces negligible computation cost.

DFS-GAN: stabilizing training of generative adversarial networks through discarding fake samples

Reducing Differences Between Real and Realistic Samples to Improve GANs

Adversarial symmetric GANs: bridging adversarial samples and adversarial networks

Discriminator rejection sampling

Exploring Guided Sampling of Conditional GANs

A New Perspective on Stabilizing GANs Training: Direct Adversarial Training

Alleviation of Gradient Exploding in GANs: Fake Can Be Real

Adaptive Weighted Discriminator for Training Generative Adversarial Networks

Incremental Focal Loss GANs.

Detecting GAN generated errors

D2PGGAN: Two Discriminators Used in Progressive Growing of GANS

DMGAN: Discriminative Metric-based Generative Adversarial Networks.

Fictitious GAN: Training GANs with Historical Models

Simple Yet Effective Way for Improving the Performance of GAN

Enhanced Generative Adversarial Networks with Restart Learning Rate in Discriminator

Differentiable Augmentation for Data-Efficient GAN Training

Improving GANs with A Dynamic Discriminator

Direct Adversarial Training: A New Approach for Stabilizing The Training Process of GANs

Towards the Gradient Vanishing, Divergence Mismatching and Mode Collapse of Generative Adversarial Nets

DuelGAN: A Duel Between Two Discriminators Stabilizes the GAN Training

Discriminative Forests Improve Generative Diversity for Generative Adversarial Networks