Abstract:Ensemble learning improves the capability of convolutional neural network (CNN)-based discriminators, whose performance is crucial to the quality of generated samples in generative adversarial network (GAN). However, this learning strategy results in a significant increase in the number of parameters along with computational overhead. Meanwhile, the suitable number of discriminators required to enhance GAN performance is still being investigated. To mitigate these issues, we propose an evidential discriminator for GAN (EviD-GAN)-code is available at https://github.com/Tohokantche/EviD-GAN-to learn both the model (epistemic) and data (aleatoric) uncertainties. Specifically, by analyzing three GAN models, the relation between the distribution of discriminator's output and the generator performance has been discovered yielding a general formulation of GAN framework. With the above analysis, the evidential discriminator learns the degree of aleatoric and epistemic uncertainties via imposing a higher order distribution constraint over the likelihood as expressed in the discriminator's output. This constraint can learn an ensemble of likelihood functions corresponding to an infinite set of discriminators. Thus, EviD-GAN aggregates knowledge through the ensemble learning of discriminator that allows the generator to benefit from an informative gradient flow at a negligible computational cost. Furthermore, inspired by the gradient direction in maximum mean discrepancy (MMD)-repulsive GAN, we design an asymmetric regularization scheme for EviD-GAN. Unlike MMD-repulsive GAN that performs at the distribution level, our regularization scheme is based on a pairwise loss function, performs at the sample level, and is characterized by an asymmetric behavior during the training of generator and discriminator. Experimental results show that the proposed evidential discriminator is cost-effective, consistently improves GAN in terms of Frechet inception distance (FID) and inception score (IS), and performs better than other competing models that use multiple discriminators.

EviD-GAN: Improving GAN With an Infinite Set of Discriminators at Negligible Cost

Improving GANs with A Dynamic Discriminator

A lightweight ensemble discriminator for Generative Adversarial Networks

Exploring Guided Sampling of Conditional GANs

Cost Ensemble with Gradient Selecting for GANs.

LDGAN: Latent Determined Ensemble Helps Removing IID Data Assumption and Cross-node Sampling in Distributed GANs

Ensemble-Based Distributed Learning for Generative Adversarial Networks.

The residual generator: An improved divergence minimization framework for GAN

Discriminator contrastive divergence: Semi-amortized generative modeling by exploring energy of the discriminator

A Multi-Player Minimax Game for Generative Adversarial Networks.

Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator

DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data

CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network

CAGAN: Consistent Adversarial Training Enhanced GANs.

Dist-GAN: An Improved GAN using Distance Constraints

MDGAN: Boosting Anomaly Detection Using \\Multi-Discriminator Generative Adversarial Networks

GEGAN: Generative Adversarial Networks Training Based on Gradient Directed Evolutionary Strategy

xAI-GAN: Enhancing Generative Adversarial Networks via Explainable AI Systems

Adaptive Weighted Discriminator for Training Generative Adversarial Networks

JDGAN: Enhancing generator on extremely limited data via joint distribution

Evolutionary Generative Adversarial Networks