Abstract:Ensemble learning improves the capability of convolutional neural network (CNN)-based discriminators, whose performance is crucial to the quality of generated samples in generative adversarial network (GAN). However, this learning strategy results in a significant increase in the number of parameters along with computational overhead. Meanwhile, the suitable number of discriminators required to enhance GAN performance is still being investigated. To mitigate these issues, we propose an evidential discriminator for GAN (EviD-GAN)-code is available at https://github.com/Tohokantche/EviD-GAN-to learn both the model (epistemic) and data (aleatoric) uncertainties. Specifically, by analyzing three GAN models, the relation between the distribution of discriminator's output and the generator performance has been discovered yielding a general formulation of GAN framework. With the above analysis, the evidential discriminator learns the degree of aleatoric and epistemic uncertainties via imposing a higher order distribution constraint over the likelihood as expressed in the discriminator's output. This constraint can learn an ensemble of likelihood functions corresponding to an infinite set of discriminators. Thus, EviD-GAN aggregates knowledge through the ensemble learning of discriminator that allows the generator to benefit from an informative gradient flow at a negligible computational cost. Furthermore, inspired by the gradient direction in maximum mean discrepancy (MMD)-repulsive GAN, we design an asymmetric regularization scheme for EviD-GAN. Unlike MMD-repulsive GAN that performs at the distribution level, our regularization scheme is based on a pairwise loss function, performs at the sample level, and is characterized by an asymmetric behavior during the training of generator and discriminator. Experimental results show that the proposed evidential discriminator is cost-effective, consistently improves GAN in terms of Frechet inception distance (FID) and inception score (IS), and performs better than other competing models that use multiple discriminators.

Adversarial Discrete Sequence Generation Without Explicit Neural Networks As Discriminators

A New Distributed Method for Training Generative Adversarial Networks

Sequence Generative Adversarial Nets with a Conditional Discriminator

SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient

Spatio-Temporal Generative Adversarial Networks

Distributed Spatio-Temporal Generative Adversarial Networks

StyleGenes: Discrete and Efficient Latent Distributions for GANs

Boundary-Seeking Generative Adversarial Networks

Sketch-then-Edit Generative Adversarial Network

Adversarial Sub-sequence for Text Generation.

EviD-GAN: Improving GAN With an Infinite Set of Discriminators at Negligible Cost

Generative Adversarial Nets

Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator

Improving GANs with A Dynamic Discriminator

Discriminator-free Generative Adversarial Attack

JDGAN: Enhancing generator on extremely limited data via joint distribution

Generative Adversarial Networks with Adaptive Learning Strategy for Noise-to-image Synthesis

Fictitious GAN: Training GANs with Historical Models

A Multi-Player Minimax Game for Generative Adversarial Networks.

Diffusion-GAN: Training GANs with Diffusion

On the Discrimination-Generalization Tradeoff in GANs