Abstract:Flow matching (FM) is a family of training algorithms for fitting continuous normalizing flows (CNFs). A standard approach to FM, called conditional flow matching (CFM), exploits the fact that the marginal vector field of a CNF can be learned by fitting least-square regression to the so-called conditional vector field specified given one or both ends of the flow path. We show that viewing CFM training from a Bayesian decision theoretic perspective on parameter estimation opens the door to generalizations of CFM algorithms. We propose one such extension by introducing a CFM algorithm based on defining conditional probability paths given what we refer to as ``streams'', instances of latent stochastic paths that connect pairs of noise and observed data. Further, we advocate the modeling of these latent streams using Gaussian processes (GPs). The unique distributional properties of GPs, and in particular the fact that the velocity of a GP is still a GP, allows drawing samples from the resulting stream-augmented conditional probability path without simulating the actual streams, and hence the ``simulation-free" nature of CFM training is preserved. We show that this generalization of the CFM can substantially reduce the variance in the estimated marginal vector field at a moderate computational cost, thereby improving the quality of the generated samples under common metrics. Additionally, we show that adopting the GP on the streams allows for flexibly linking multiple related training data points (e.g., time series) and incorporating additional prior information. We empirically validate our claim through both simulations and applications to two hand-written image datasets.

Bayesian Flow Networks in Continual Learning

Bayesian Structure Learning with Generative Flow Networks

Bifurcated Generative Flow Networks

ParamReL: Learning Parameter Space Representation via Progressively Encoding Bayesian Flow Networks

Investigating Generalization Behaviours of Generative Flow Networks

Generative Flow Networks: a Markov Chain Perspective

Continuous Graph Flow

Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Network

Unifying Bayesian Flow Networks and Diffusion Models through Stochastic Differential Equations

Bayesian learning of Causal Structure and Mechanisms with GFlowNets and Variational Bayes

DynGFN: Towards Bayesian Inference of Gene Regulatory Networks with GFlowNets

Flow Matching for Generative Modeling

Neural Conjugate Flows: Physics-informed architectures with flow structure

CFlowNets: Continuous Control with Generative Flow Networks

Continuous-Time Flows for Efficient Inference and Density Estimation

Stochastic Generative Flow Networks

DGFN: Double Generative Flow Networks

Stream-level flow matching from a Bayesian decision theoretic perspective

Improving and generalizing flow-based generative models with minibatch optimal transport

Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarks