Abstract:Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of probability measures open up new avenues for algorithm development. This paper makes three contributions to this sampling approach by scrutinizing the design components of such gradient flows. Any instantiation of a gradient flow for sampling needs an energy functional and a metric to determine the flow, as well as numerical approximations of the flow to derive algorithms. Our first contribution is to show that the Kullback-Leibler divergence, as an energy functional, has the unique property (among all f-divergences) that gradient flows resulting from it do not depend on the normalization constant of the target distribution. Our second contribution is to study the choice of metric from the perspective of invariance. The Fisher-Rao metric is known as the unique choice (up to scaling) that is diffeomorphism invariant. As a computationally tractable alternative, we introduce a relaxed, affine invariance property for the metrics and gradient flows. In particular, we construct various affine invariant Wasserstein and Stein gradient flows. Affine invariant gradient flows are shown to behave more favorably than their non-affine-invariant counterparts when sampling highly anisotropic distributions, in theory and by using particle methods. Our third contribution is to study, and develop efficient algorithms based on Gaussian approximations of the gradient flows; this leads to an alternative to particle methods. We establish connections between various Gaussian approximate gradient flows, discuss their relation to gradient methods arising from parametric variational inference, and study their convergence properties both theoretically and numerically.

Lipschitz-regularized gradient flows and generative particle algorithms for high-dimensional scarce data

Sampling via Gradient Flows in the Space of Probability Measures

Generative Assignment Flows for Representing and Learning Joint Distributions of Discrete Data

Generative Learning With Euler Particle Transport

Large-Scale Wasserstein Gradient Flows

Sampling with flows, diffusion, and autoregressive neural networks from a spin-glass perspective

Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective

Convergence of flow-based generative models via proximal gradient descent in Wasserstein space

Wasserstein Flow Matching: Generative modeling over families of distributions

Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimization

A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models

Flow Annealed Importance Sampling Bootstrap meets Differentiable Particle Physics

Analysis of learning a flow-based generative model from limited sample complexity

Generative Modeling with Flow-Guided Density Ratio Learning

New algorithms for sampling and diffusion models

Renormalization Group flow, Optimal Transport and Diffusion-based Generative Model

Random Growth via Gradient Flow Aggregation

Annealing Flow Generative Model Towards Sampling High-Dimensional and Multi-Modal Distributions

Fisher Flow Matching for Generative Modeling over Discrete Data

Differentially Private Gradient Flow based on the Sliced Wasserstein Distance

Gradient flows on graphons: existence, convergence, continuity equations