Abstract:This study investigates the effects of Markov chain Monte Carlo (MCMC) sampling in unsupervised Maximum Likelihood (ML) learning. Our attention is restricted to the family of unnormalized probability densities for which the negative log density (or energy function) is a ConvNet. We find that many of the techniques used to stabilize training in previous studies are not necessary. ML learning with a ConvNet potential requires only a few hyper-parameters and no regularization. Using this minimal framework, we identify a variety of ML learning outcomes that depend solely on the implementation of MCMC sampling. On one hand, we show that it is easy to train an energy-based model which can sample realistic images with short-run Langevin. ML can be effective and stable even when MCMC samples have much higher energy than true steady-state samples throughout training. Based on this insight, we introduce an ML method with purely noise-initialized MCMC, high-quality short-run synthesis, and the same budget as ML with informative MCMC initialization such as CD or PCD. Unlike previous models, our energy model can obtain realistic high-diversity samples from a noise signal after training. On the other hand, ConvNet potentials learned with non-convergent MCMC do not have a valid steady-state and cannot be considered approximate unnormalized densities of the training data because long-run MCMC samples differ greatly from observed images. We show that it is much harder to train a ConvNet potential to learn a steady-state over realistic images. To our knowledge, long-run MCMC samples of all previous models lose the realism of short-run samples. With correct tuning of Langevin noise, we train the first ConvNet potentials for which long-run and steady-state MCMC samples are realistic images.

Persistently Trained, Diffusion-assisted Energy-based Models

Training Energy-Based Models with Diffusion Contrastive Divergences

Learning Energy-Based Prior Model with Diffusion-Amortized MCMC

Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood

Improving Adversarial Energy-Based Model via Diffusion Process

Latent Diffusion Energy-Based Model for Interpretable Text Modeling

Energy-Based Modelling for Discrete and Mixed Data via Heat Equations on Structured Spaces

Maximum Entropy Inverse Reinforcement Learning of Diffusion Models with Energy-Based Models

Generalized Contrastive Divergence: Joint Training of Energy-Based Model and Diffusion Model through Inverse Reinforcement Learning

On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Models

Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery Approach

Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model

Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon

Learning Latent Space Hierarchical EBM Diffusion Models

Efficient Training of Energy-Based Models Using Jarzynski Equality

Latent-based Diffusion Model for Long-tailed Recognition

FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model

Particle Dynamics for Learning EBMs

Learning Energy-Based Models in High-Dimensional Spaces with Multiscale Denoising-Score Matching

M-EBM: Towards Understanding the Manifolds of Energy-Based Models

STANLEY: Stochastic Gradient Anisotropic Langevin Dynamics for Learning Energy-Based Models