Abstract:Generative adversarial networks (GANs), which are famous for the capability of learning complex underlying data distribution, are, however, known to be tricky in the training process, which would probably result in mode collapse or performance deterioration. Current approaches of dealing with GANs' issues almost utilize some practical training techniques for the purpose of regularization, which, on the other hand, undermines the convergence and theoretical soundness of GAN. In this article, we propose to stabilize GAN training via a novel particle-based variational inference-Langevin Stein variational gradient descent (LSVGD), which not only inherits the flexibility and efficiency of original SVGD but also aims to address its instability issues by incorporating an extra disturbance into the update dynamics. We further demonstrate that, by properly adjusting the noise variance, LSVGD simulates a Langevin process whose stationary distribution is exactly the target distribution. We also show that LSVGD dynamics has an implicit regularization, which is able to enhance particles' spread-out and diversity. Finally, we present an efficient way of applying particle-based variational inference on a general GAN training procedure no matter what loss function is adopted. Experimental results on one synthetic data set and three popular benchmark data sets-Cifar-10, Tiny-ImageNet, and CelebA-validate that LSVGD can remarkably improve the performance and stability of various GAN models.

Stabilizing Training of Generative Adversarial Nets via Langevin Stein Variational Gradient Descent

Stabilizing Training of Generative Adversarial Nets via Langevin Stein Variational Gradient Descent

Direct Adversarial Training: A New Approach for Stabilizing The Training Process of GANs

A New Perspective on Stabilizing GANs Training: Direct Adversarial Training

Stabilizing Training of Generative Adversarial Networks through Regularization

Understanding and Stabilizing GANs' Training Dynamics with Control Theory

Training Generative Adversarial Networks by Solving Ordinary Differential Equations

Direct Adversarial Training for GANs

Training Generative Adversarial Networks in One Stage

Understanding GANs in the LQG Setting: Formulation, Generalization and Stability

Direct Adversarial Training: An Adaptive Method to Penalize Lipschitz Continuity of the Discriminator

On Stabilizing Generative Adversarial Training with Noise

Training Generative Adversarial Networks by Auxiliary Adversarial Example Regulator

Intervention Generative Adversarial Networks

Smoothness and Stability in GANs

Instability analysis for generative adversarial networks and its solving techniques

Stabilizing Generative Adversarial Networks: A Survey

A Closer Look at the Optimization Landscapes of Generative Adversarial Networks

Utilizing Amari-Alpha Divergence to Stabilize the Training of Generative Adversarial Networks

Improving the Improved Training of Wasserstein GANs: A Consistency Term and Its Dual Effect