Abstract:Generative adversarial networks (GANs), famous for the capability of learning complex underlying data distribution, are however known to be tricky in the training process, which would probably result in mode collapse or performance deterioration. Current approaches of dealing with GANs' issues almost utilize some practical training techniques for the purpose of regularization, which on the other hand undermines the convergence and theoretical soundness of GAN. In this paper, we propose to stabilize GAN training via a novel particle-based variational inference -- Langevin Stein variational gradient descent (LSVGD), which not only inherits the flexibility and efficiency of original SVGD but aims to address its instability issues by incorporating an extra disturbance into the update dynamics. We further demonstrate that by properly adjusting the noise variance, LSVGD simulates a Langevin process whose stationary distribution is exactly the target distribution. We also show that LSVGD dynamics has an implicit regularization which is able to enhance particles' spread-out and diversity. At last we present an efficient way of applying particle-based variational inference on a general GAN training procedure no matter what loss function is adopted. Experimental results on one synthetic dataset and three popular benchmark datasets -- Cifar-10, Tiny-ImageNet and CelebA validate that LSVGD can remarkably improve the performance and stability of various GAN models.

Alleviating limit cycling in training GANs with an optimization technique

Addressing GAN Training Instabilities via Tunable Classification Losses

Training Generative Adversarial Networks with Adaptive Composite Gradient

Limiting Behaviors of Nonconvex-Nonconcave Minimax Optimization via Continuous-Time Systems

Convergence of GANs Training: A Game and Stochastic Control Methodology

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs Via Gradient Analysis.

Improving OPT-GAN by Smooth Scale Mapping and Adaptive Exploration

Training Generative Adversarial Networks in One Stage

Two steps at a time -- taking GAN training in stride with Tseng's method

Lipschitz Constrained GANs via Boundedness and Continuity

Progressive Growing of GANs for Improved Quality, Stability, and Variation

Restricting Greed in Training of Generative Adversarial Network

Stabilizing Training of Generative Adversarial Nets via Langevin Stein Variational Gradient Descent

CHAIN: Enhancing Generalization in Data-Efficient GANs via lipsCHitz continuity constrAIned Normalization

Effective Lipschitz constraint enforcement for Wasserstein GAN training

Towards a Better Understanding and Regularization of GAN Training Dynamics

Interaction Matters: A Note on Non-asymptotic Local Convergence of Generative Adversarial Networks

Improving GANs with A Dynamic Discriminator

GL-GAN: Adaptive Global and Local Bilevel Optimization model of Image Generation

Improving the Speed and Quality of GAN by Adversarial Training