Abstract:Ensemble learning improves the capability of convolutional neural network (CNN)-based discriminators, whose performance is crucial to the quality of generated samples in generative adversarial network (GAN). However, this learning strategy results in a significant increase in the number of parameters along with computational overhead. Meanwhile, the suitable number of discriminators required to enhance GAN performance is still being investigated. To mitigate these issues, we propose an evidential discriminator for GAN (EviD-GAN)-code is available at https://github.com/Tohokantche/EviD-GAN-to learn both the model (epistemic) and data (aleatoric) uncertainties. Specifically, by analyzing three GAN models, the relation between the distribution of discriminator's output and the generator performance has been discovered yielding a general formulation of GAN framework. With the above analysis, the evidential discriminator learns the degree of aleatoric and epistemic uncertainties via imposing a higher order distribution constraint over the likelihood as expressed in the discriminator's output. This constraint can learn an ensemble of likelihood functions corresponding to an infinite set of discriminators. Thus, EviD-GAN aggregates knowledge through the ensemble learning of discriminator that allows the generator to benefit from an informative gradient flow at a negligible computational cost. Furthermore, inspired by the gradient direction in maximum mean discrepancy (MMD)-repulsive GAN, we design an asymmetric regularization scheme for EviD-GAN. Unlike MMD-repulsive GAN that performs at the distribution level, our regularization scheme is based on a pairwise loss function, performs at the sample level, and is characterized by an asymmetric behavior during the training of generator and discriminator. Experimental results show that the proposed evidential discriminator is cost-effective, consistently improves GAN in terms of Frechet inception distance (FID) and inception score (IS), and performs better than other competing models that use multiple discriminators.

Discriminator Variance Regularization for Wasserstein GAN

Adversarial Lipschitz Regularization

Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Are

Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator

Orthogonal Wasserstein GANs

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs Via Gradient Analysis.

How Does Lipschitz Regularization Influence GAN Training?

Local Stability of Wasserstein GANs With Abstract Gradient Penalty

A Wasserstein GAN model with the total variational regularization

Adaptive Spectral Normalization for Generative Models

On the Discrimination-Generalization Tradeoff in GANs

Effective Lipschitz constraint enforcement for Wasserstein GAN training

DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data

The relativistic discriminator: a key element missing from standard GAN

EviD-GAN: Improving GAN With an Infinite Set of Discriminators at Negligible Cost

Lipschitz Generative Adversarial Nets

The residual generator: An improved divergence minimization framework for GAN

Some Theoretical Insights into Wasserstein GANs

Wasserstein Divergence for GANs

How Well Generative Adversarial Networks Learn Distributions