Abstract:Generative adversarial networks (GANs) have proven successful in image generation tasks. However, GAN training is inherently unstable. Although many works try to stabilize it by manually modifying GAN architecture, it requires much expertise. Neural architecture search (NAS) has become an attractive solution to search GANs automatically. The early NAS-GANs search only generators to reduce search complexity but lead to a sub-optimal GAN. Some recent works try to search both generator (G) and discriminator (D), but they suffer from the instability of GAN training. To alleviate the instability, we propose an efficient two-stage evolutionary algorithm-based NAS framework to search GANs, namely EAGAN. We decouple the search of G and D into two stages, where stage-1 searches G with a fixed D and adopts the many-to-one training strategy, and stage-2 searches D with the optimal G found in stage-1 and adopts the one-to-one training and weight-resetting strategies to enhance the stability of GAN training. Both stages use the non-dominated sorting method to produce Pareto-front architectures under multiple objectives (e.g., model size, Inception Score (IS), and Fréchet Inception Distance (FID)). EAGAN is applied to the unconditional image generation task and can efficiently finish the search on the CIFAR-10 dataset in 1.2 GPU days. Our searched GANs achieve competitive results (IS=8.81$\pm$0.10, FID=9.91) on the CIFAR-10 dataset and surpass prior NAS-GANs on the STL-10 dataset (IS=10.44$\pm$0.087, FID=22.18). Source code: <a class="link-external link-https" href="https://github.com/marsggbo/EAGAN" rel="external noopener nofollow">this https URL</a>.

Searching Towards Class-Aware Generators for Conditional Generative Adversarial Networks

Statistics Enhancement Generative Adversarial Networks for Diverse Conditional Image Synthesis

Coarse-to-Fine Searching for Efficient Generative Adversarial Networks.

AdversarialNAS: Adversarial Neural Architecture Search for GANs.

CAGAN: Constrained Neural Architecture Search for GANs

Neural Characteristic Function Learning for Conditional Image Generation.

AutoGAN: Neural Architecture Search for Generative Adversarial Networks

A neural architecture generator for efficient search space

EAGAN: Efficient Two-stage Evolutionary Architecture Search for GANs

Generative Adversarial Neural Architecture Search

Ways of Conditioning Generative Adversarial Networks

Distributed GAN: Toward a Faster Reinforcement-Learning-Based Architecture Search

Efficient Conditional GAN Transfer with Knowledge Propagation across Classes

Vsa-Cgan: An Intelligent Generation Model For Deep Learning Sample Database Construction

Neural Architecture Search based on Cartesian Genetic Programming Coding Method

GANs Conditioning Methods: A Survey

Evolutionary Architectural Search for Generative Adversarial Networks

Class Conditional Time Series Generation with Structured Noise Space GAN

Off-Policy Reinforcement Learning for Efficient and Effective GAN Architecture Search

Structured Generative Adversarial Networks.

Leveraging Conditional Generative Adversarial Networks (cGANs) for enhanced artistic creation: Exploring quality improvement and content control through conditional inputs