Abstract:Generative adversarial networks (GANs), famous for the capability of learning complex underlying data distribution, are however known to be tricky in the training process, which would probably result in mode collapse or performance deterioration. Current approaches of dealing with GANs' issues almost utilize some practical training techniques for the purpose of regularization, which on the other hand undermines the convergence and theoretical soundness of GAN. In this paper, we propose to stabilize GAN training via a novel particle-based variational inference -- Langevin Stein variational gradient descent (LSVGD), which not only inherits the flexibility and efficiency of original SVGD but aims to address its instability issues by incorporating an extra disturbance into the update dynamics. We further demonstrate that by properly adjusting the noise variance, LSVGD simulates a Langevin process whose stationary distribution is exactly the target distribution. We also show that LSVGD dynamics has an implicit regularization which is able to enhance particles' spread-out and diversity. At last we present an efficient way of applying particle-based variational inference on a general GAN training procedure no matter what loss function is adopted. Experimental results on one synthetic dataset and three popular benchmark datasets -- Cifar-10, Tiny-ImageNet and CelebA validate that LSVGD can remarkably improve the performance and stability of various GAN models.

Stabilizing Training of Generative Adversarial Networks through Regularization

Direct Adversarial Training: A New Approach for Stabilizing The Training Process of GANs

A Large-Scale Study on Regularization and Normalization in GANs

Stabilizing Training of Generative Adversarial Nets via Langevin Stein Variational Gradient Descent

Consistency Regularization for Generative Adversarial Networks

A New Perspective on Stabilizing GANs Training: Direct Adversarial Training

Regularization and Normalization for Generative Adversarial Networks: A Review

Regularization Methods for Generative Adversarial Networks: An Overview of Recent Studies

Mode Regularized Generative Adversarial Networks

Flooding Regularization for Stable Training of Generative Adversarial Networks

Stabilizing Generative Adversarial Networks: A Survey

Regularizing Generative Adversarial Networks under Limited Data

Diversity Regularized Adversarial Learning

Training Generative Adversarial Networks by Solving Ordinary Differential Equations

Adversarial Lipschitz Regularization

Smoothness and Stability in GANs

Kernel-Guided Training of Implicit Generative Models with Stability Guarantees

Understanding and Stabilizing GANs' Training Dynamics with Control Theory

Training Generative Adversarial Networks by Auxiliary Adversarial Example Regulator

MS^3D: A RG Flow-Based Regularization for GAN Training with Limited Data