Abstract:The generator in the generative adversarial network (GAN) learns image generation in a coarse-to-fine manner in which earlier layers learn the overall structure of the image and the latter ones refine the details. To propagate the coarse information well, recent works usually build their generators by stacking up multiple residual blocks. Although the residual block can produce a high-quality image as well as be trained stably, it often impedes the information flow in the network. To alleviate this problem, this brief introduces a novel generator architecture that produces the image by combining features obtained through two different branches: the main and auxiliary branches. The goal of the main branch is to produce the image by passing through the multiple residual blocks, whereas the auxiliary branch is to convey the coarse information in the earlier layer to the later one. To combine the features in the main and auxiliary branches successfully, we also propose a gated feature fusion module that controls the information flow in those branches. To prove the superiority of the proposed method, this brief provides extensive experiments using various standard datasets including CIFAR-10, CIFAR-100, LSUN, CelebA-HQ, AFHQ, and tiny-ImageNet. Furthermore, we conducted various ablation studies to demonstrate the generalization ability of the proposed method. Quantitative evaluations prove that the proposed method exhibits impressive GAN performance in terms of Inception score (IS) and Frechet inception distance (FID). For instance, the proposed method boosts the FID and IS scores on the tiny-ImageNet dataset from 35.13 to 25.00 and 20.23 to 25.57, respectively.

Introspective GAN: Learning to grow a GAN for incremental generation and classification

Incremental Focal Loss GANs.

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Incremental learning for the detection and classification of GAN-generated images

Incremental Classifier Learning with Generative Adversarial Networks

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

A Novel Generator with Auxiliary Branch for Improving GAN Performance

Training Generative Adversarial Networks in One Stage

Progressive Growing of GANs for Improved Quality, Stability, and Variation

Improving GAN Training via Feature Space Shrinkage

Conservative Generator, Progressive Discriminator: Coordination of Adversaries in Few-shot Incremental Image Synthesis

Bypassing Logits Bias in Online Class-Incremental Learning with a Generative Framework

Analysis of Continual Learning Techniques for Image Generative Models with Learned Class Information Management

Lifelong Dual Generative Adversarial Nets Learning in Tandem

GAN Memory with No Forgetting

Omni-GAN: on the Secrets of Cgans and Beyond

GIU-GANs: Global Information Utilization for Generative Adversarial Networks

Rob-GAN: Generator, Discriminator, and Adversarial Attacker

Simple Yet Effective Way for Improving the Performance of GAN

Introspective Classification with Convolutional Nets