Abstract:Original data usually lies on a set of disconnected manifolds rather than a smooth connected manifold. This causes the problem of mode collapse in the training of vanilla Generative Adversarial Network (GAN). There are many existing GAN variants that attempt to address this problem, but they result in limitations. The existing variants either produce simulated instances with low quality or generate identical simulated instances. In this study, we propose a new approach to training GAN utilizing multiple generators, a classifier and a discriminator to address mode collapse. The classifier outputs the statistical probabilities of generated data belonging to a specific category. These probabilities implicitly reflect which manifolds are captured by generators, and the correlation between generators is quantified by mutual information. Our idea views the mutual information values as a constraint to guide generators in learning different manifolds. Specifically, we traverse the generators, calculating the mutual information between each generator and the others. The calculated values are integrated into the generator loss to form a new generator loss and to update the corresponding generator's parameters, using back-propagation. We minimize the mutual information to reduce the correlation between generators while also minimizing the generator loss. This ensures generators capture different manifolds while updating their parameters. A new minimax formula is established to train our approach in a similar spirit to vanilla GAN. We term our approach Mutual Information Multi-generator GAN (MIM-GAN). We conduct extensive experiments utilizing the MNIST, CIFAR10 and CelebA datasets to demonstrate the significant performance improvement of MIM-GAN in both achieving the highest Inception Scores and producing diverse generated data at different resolutions.

MIXGAN: Learning Concepts from Different Domains for Mixture Generation

Creative and Diverse Artwork Generation Using Adversarial Networks

MemoryGAN: GAN Generator As Heterogeneous Memory for Compositional Image Synthesis

Hierarchical Mixtures of Generators for Adversarial Learning

Few-shot Hybrid Domain Adaptation of Image Generator

Multi-distribution Mixture Generative Adversarial Networks for Fitting Diverse Data Sets

Improving GAN Training via Feature Space Shrinkage

Domain Generalization with MixStyle

Generate Desired Images from Trained Generative Adversarial Networks.

CatGAN: Coupled Adversarial Transfer for Domain Generation.

ScoreMix: A Scalable Augmentation Strategy for Training GANs with Limited Data

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Generative Adversarial Networks with Mixture of T-Distributions Noise for Diverse Image Generation.

GAN Cocktail: Mixing GANs Without Dataset Access

ML-CookGAN: Multi-Label Generative Adversarial Network for Food Image Generation

SynthMix: Mixing up Aligned Synthesis for Medical Cross-Modality Domain Adaptation

SoloGAN: Multi-domain Multimodal Unpaired Image-to-Image Translation Via a Single Generative Adversarial Network

Modular Generative Adversarial Networks

CycleMix: Mixing Source Domains for Domain Generalization in Style-Dependent Data

Multi-generator GAN learning disconnected manifolds with mutual information

Heterogeneous Domain Generalization via Domain Mixup