Abstract:This paper studies the cooperative learning of two generative flow models, in which the two models are iteratively updated based on the jointly synthesized examples. The first flow model is a normalizing flow that transforms an initial simple density to a target density by applying a sequence of invertible transformations. The second flow model is a Langevin flow that runs finite steps of gradient-based MCMC toward an energy-based model. We start from proposing a generative framework that trains an energy-based model with a normalizing flow as an amortized sampler to initialize the MCMC chains of the energy-based model. In each learning iteration, we generate synthesized examples by using a normalizing flow initialization followed by a short-run Langevin flow revision toward the current energy-based model. Then we treat the synthesized examples as fair samples from the energy-based model and update the model parameters with the maximum likelihood learning gradient, while the normalizing flow directly learns from the synthesized examples by maximizing the tractable likelihood. Under the short-run non-mixing MCMC scenario, the estimation of the energy-based model is shown to follow the perturbation of maximum likelihood, and the short-run Langevin flow and the normalizing flow form a two-flow generator that we call CoopFlow. We provide an understating of the CoopFlow algorithm by information geometry and show that it is a valid generator as it converges to a moment matching estimator. We demonstrate that the trained CoopFlow is capable of synthesizing realistic images, reconstructing images, and interpolating between images.

ImitationFlow: Learning Deep Stable Stochastic Dynamic Systems by Normalizing Flows

Stable Neural Flows

Stochastic Generative Flow Networks

Stochastic Normalizing Flows

Stable Autonomous Flow Matching

A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Model

Flow Map Matching

Q-Flow: Generative Modeling for Differential Equations of Open Quantum Dynamics with Normalizing Flows

A Coupled Flow Approach to Imitation Learning

Piecewise Normalizing Flows

Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarks

Time-changed normalizing flows for accurate SDE modeling

Model-Free Stochastic Process Modeling and Optimization using Normalizing Flows

A Tale of Two Latent Flows: Learning Latent Space Normalizing Flow with Short-run Langevin Flow for Approximate Inference

IL-flOw: Imitation Learning from Observation using Normalizing Flows

Unifying Predictions of Deterministic and Stochastic Physics in Mesh-reduced Space with Sequential Flow Generative Model

A pseudo-reversible normalizing flow for stochastic dynamical systems with various initial distributions

Flow-based Spatio-Temporal Structured Prediction of Motion Dynamics

Implicit Normalizing Flows

Stochastic Sampling from Deterministic Flow Models

Learning Stable Deep Dynamics Models