Abstract:Due to the outstanding capability for data generation, Generative Adversarial Networks (GANs) have attracted considerable attention in unsupervised learning. However, training GANs is difficult, since the training distribution is dynamic for the discriminator, leading to unstable image representation. In this paper, we address the problem of training GANs from a novel perspective, \emph{i.e.,} robust image classification. Motivated by studies on robust image representation, we propose a simple yet effective module, namely AdaptiveMix, for GANs, which shrinks the regions of training data in the image representation space of the discriminator. Considering it is intractable to directly bound feature space, we propose to construct hard samples and narrow down the feature distance between hard and easy samples. The hard samples are constructed by mixing a pair of training images. We evaluate the effectiveness of our AdaptiveMix with widely-used and state-of-the-art GAN architectures. The evaluation results demonstrate that our AdaptiveMix can facilitate the training of GANs and effectively improve the image quality of generated samples. We also show that our AdaptiveMix can be further applied to image classification and Out-Of-Distribution (OOD) detection tasks, by equipping it with state-of-the-art methods. Extensive experiments on seven publicly available datasets show that our method effectively boosts the performance of baselines. The code is publicly available at <a class="link-external link-https" href="https://github.com/WentianZhang-ML/AdaptiveMix" rel="external noopener nofollow">this https URL</a>.

ScoreMix: A Scalable Augmentation Strategy for Training GANs with Limited Data

Improving GAN Training via Feature Space Shrinkage

Differentiable Augmentation for Data-Efficient GAN Training

SMaRt: Improving GANs with Score Matching Regularity

Incremental Focal Loss GANs.

WeMix: How to Better Utilize Data Augmentation

GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing

Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis.

MixGen: A New Multi-Modal Data Augmentation

GenMix: Combining Generative and Mixture Data Augmentation for Medical Image Classification

Data Augmentation Based on Generative Adversarial Network with Mixed Attention Mechanism

SynthMix: Mixing up Aligned Synthesis for Medical Cross-Modality Domain Adaptation

Image Augmentations for GAN Training

ProtoGAN: Towards High Diversity and Fidelity Image Synthesis under Limited Data

LatentAugment: Data Augmentation via Guided Manipulation of GAN's Latent Space

GAN Cocktail: Mixing GANs Without Dataset Access

Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective

TransformMix: Learning Transformation and Mixing Strategies from Data

Score Mismatching for Generative Modeling

GANs Settle Scores!

Optimization of Cardiac Magnetic Resonance Synthetic Image Based on Simulated Generative Adversarial Network