Abstract:Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statistics as the training samples. One major form of training failure, known as mode collapse, involves the generator failing to reproduce the full diversity of modes in the target probability distribution. Here, we present an effective model of GAN training, which captures the learning dynamics by replacing the generator neural network with a collection of particles in the output space; particles are coupled by a universal kernel valid for certain wide neural networks and high-dimensional inputs. The generality of our simplified model allows us to study the conditions under which mode collapse occurs. Indeed, experiments which vary the effective kernel of the generator reveal a mode collapse transition, the shape of which can be related to the type of discriminator through the frequency principle. Further, we find that gradient regularizers of intermediate strengths can optimally yield convergence through critical damping of the generator dynamics. Our effective GAN model thus provides an interpretable physical framework for understanding and improving adversarial training. https://doi.org/10.1103/PhysRevX.13.041004 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

GAN: Dynamics

On Convergence and Stability of GANs

Local Stability of Wasserstein GANs With Abstract Gradient Penalty

Some Theoretical Insights into Wasserstein GANs

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs Via Gradient Analysis.

Limiting Behaviors of Nonconvex-Nonconcave Minimax Optimization via Continuous-Time Systems

Understanding the Effectiveness of Lipschitz-Continuity in Generative Adversarial Nets

Convergence Dynamics of Generative Adversarial Networks: The Dual Metric Flows

Towards a Better Understanding and Regularization of GAN Training Dynamics

Local Convergence of Gradient Descent-Ascent for Training Generative Adversarial Networks

Smoothness and Stability in GANs

Convergence of GANs Training: A Game and Stochastic Control Methodology

Effective Dynamics of Generative Adversarial Networks

A Differential Equation Approach for Wasserstein GANs and Beyond

Instability and Local Minima in GAN Training with Kernel Discriminators

Lipschitz Generative Adversarial Nets

Lipschitz Constrained GANs via Boundedness and Continuity

Dynamics of Fourier Modes in Torus Generative Adversarial Networks

Understanding and Stabilizing GANs' Training Dynamics with Control Theory

Global Convergence to the Equilibrium of GANs using Variational Inequalities