Abstract:This study investigates the effects of Markov chain Monte Carlo (MCMC) sampling in unsupervised Maximum Likelihood (ML) learning. Our attention is restricted to the family of unnormalized probability densities for which the negative log density (or energy function) is a ConvNet. We find that many of the techniques used to stabilize training in previous studies are not necessary. ML learning with a ConvNet potential requires only a few hyper-parameters and no regularization. Using this minimal framework, we identify a variety of ML learning outcomes that depend solely on the implementation of MCMC sampling. On one hand, we show that it is easy to train an energy-based model which can sample realistic images with short-run Langevin. ML can be effective and stable even when MCMC samples have much higher energy than true steady-state samples throughout training. Based on this insight, we introduce an ML method with purely noise-initialized MCMC, high-quality short-run synthesis, and the same budget as ML with informative MCMC initialization such as CD or PCD. Unlike previous models, our energy model can obtain realistic high-diversity samples from a noise signal after training. On the other hand, ConvNet potentials learned with non-convergent MCMC do not have a valid steady-state and cannot be considered approximate unnormalized densities of the training data because long-run MCMC samples differ greatly from observed images. We show that it is much harder to train a ConvNet potential to learn a steady-state over realistic images. To our knowledge, long-run MCMC samples of all previous models lose the realism of short-run samples. With correct tuning of Langevin noise, we train the first ConvNet potentials for which long-run and steady-state MCMC samples are realistic images.

Learning Deep Energy Models: Contrastive Divergence vs. Amortized MLE

Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator

Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Learning

Training Energy-Based Models with Diffusion Contrastive Divergences

Guiding Energy-based Models via Contrastive Latent Variables

Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler

A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Training

Learning Energy-Based Prior Model with Diffusion-Amortized MCMC

Magnetic resonance imaging reconstruction using a deep energy-based model

STANLEY: Stochastic Gradient Anisotropic Langevin Dynamics for Learning Energy-Based Models

Persistently Trained, Diffusion-assisted Energy-based Models

Comparative Analysis of Generative Models: Enhancing Image Synthesis with VAEs, GANs, and Stable Diffusion

A Connection between Generative Adversarial Networks, Inverse Reinforcement Learning, and Energy-Based Models

Learning Multi-grid Generative ConvNets by Minimal Contrastive Divergence.

Generalized Contrastive Divergence: Joint Training of Energy-Based Model and Diffusion Model through Inverse Reinforcement Learning

Contrastive latent variable models for neural text generation.

Langevin Autoencoders for Learning Deep Latent Variable Models

On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Models

Energy-Based Contrastive Learning of Visual Representations

Efficient Training of Energy-Based Models Using Jarzynski Equality

Stabilizing Training of Generative Adversarial Nets via Langevin Stein Variational Gradient Descent