Abstract:Ensemble learning improves the capability of convolutional neural network (CNN)-based discriminators, whose performance is crucial to the quality of generated samples in generative adversarial network (GAN). However, this learning strategy results in a significant increase in the number of parameters along with computational overhead. Meanwhile, the suitable number of discriminators required to enhance GAN performance is still being investigated. To mitigate these issues, we propose an evidential discriminator for GAN (EviD-GAN)-code is available at https://github.com/Tohokantche/EviD-GAN-to learn both the model (epistemic) and data (aleatoric) uncertainties. Specifically, by analyzing three GAN models, the relation between the distribution of discriminator's output and the generator performance has been discovered yielding a general formulation of GAN framework. With the above analysis, the evidential discriminator learns the degree of aleatoric and epistemic uncertainties via imposing a higher order distribution constraint over the likelihood as expressed in the discriminator's output. This constraint can learn an ensemble of likelihood functions corresponding to an infinite set of discriminators. Thus, EviD-GAN aggregates knowledge through the ensemble learning of discriminator that allows the generator to benefit from an informative gradient flow at a negligible computational cost. Furthermore, inspired by the gradient direction in maximum mean discrepancy (MMD)-repulsive GAN, we design an asymmetric regularization scheme for EviD-GAN. Unlike MMD-repulsive GAN that performs at the distribution level, our regularization scheme is based on a pairwise loss function, performs at the sample level, and is characterized by an asymmetric behavior during the training of generator and discriminator. Experimental results show that the proposed evidential discriminator is cost-effective, consistently improves GAN in terms of Frechet inception distance (FID) and inception score (IS), and performs better than other competing models that use multiple discriminators.

The residual generator: An improved divergence minimization framework for GAN

GANs beyond divergence minimization

A Convex Duality Framework for GANs

Many paths to equilibrium: GANs do not need to decrease a divergence at every step

Towards the Gradient Vanishing, Divergence Mismatching and Mode Collapse of Generative Adversarial Nets

The relativistic discriminator: a key element missing from standard GAN

Discriminator contrastive divergence: Semi-amortized generative modeling by exploring energy of the discriminator

EviD-GAN: Improving GAN With an Infinite Set of Discriminators at Negligible Cost

Gang of GANs: Generative Adversarial Networks with Maximum Margin Ranking

MCGAN: Enhancing GAN Training with Regression-Based Generator Loss

Bridging the Gap Between $f$-GANs and Wasserstein GANs

GANs Settle Scores!

A Framework of Composite Functional Gradient Methods for Generative Adversarial Models

Dist-GAN: An Improved GAN using Distance Constraints

Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator

The theoretical research of generative adversarial networks: an overview

Towards a Better Global Loss Landscape of GANs

On Convergence and Stability of GANs

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs Via Gradient Analysis.

Understanding the Effectiveness of Lipschitz-Continuity in Generative Adversarial Nets