Abstract:Beyond estimating parameters of interest from data, one of the key goals of statistical inference is to properly quantify uncertainty in these estimates. In Bayesian inference, this uncertainty is provided by the posterior distribution, the computation of which typically involves an intractable high-dimensional integral. Among available approximation methods, sampling-based approaches come with strong theoretical guarantees but scale poorly to large problems, while variational approaches scale well but offer few theoretical guarantees. In particular, variational methods are known to produce overconfident estimates of posterior uncertainty and are typically non-identifiable, with many latent variable configurations generating equivalent predictions. Here, we address these challenges by showing how diffusion-based models (DBMs), which have recently produced state-of-the-art performance in generative modeling tasks, can be repurposed for performing calibrated, identifiable Bayesian inference. By exploiting a previously established connection between the stochastic and probability flow ordinary differential equations (pfODEs) underlying DBMs, we derive a class of models, inflationary flows, that uniquely and deterministically map high-dimensional data to a lower-dimensional Gaussian distribution via ODE integration. This map is both invertible and neighborhood-preserving, with controllable numerical error, with the result that uncertainties in the data are correctly propagated to the latent space. We demonstrate how such maps can be learned via standard DBM training using a novel noise schedule and are effective at both preserving and reducing intrinsic data dimensionality. The result is a class of highly expressive generative models, uniquely defined on a low-dimensional latent space, that afford principled Bayesian inference.

Bayesian Inference Via Filtering Equations for Ultrahigh Frequency Data (I): Model and Estimation

Estimation and Inference in Fractional Ornstein–Uhlenbeck Model with Discrete-Sampled Data∗

Distributed Robust Bayesian Filtering for State Estimation.

Bayesian modeling and forecasting of 24-hour high-frequency volatility: A case study of the financial crisis

Bayesian Lattice Filters for Time-Varying Autoregression and Time-Frequency Analysis

Bayesian semi-parametric estimation of compound inhomogeneous Poisson processes for ultra-high frequency financial transaction data

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Bayesian Estimation of Dynamic Asset Pricing Models with Informative Observations

Hawkes process model with a time-dependent background rate and its application to high-frequency financial data

Sequential empirical Bayes method for filtering dynamic spatiotemporal processes

Bayesian Circular Lattice Filters for Computationally Efficient Estimation of Multivariate Time-Varying Autoregressive Models

Bayesian Filtering for High-Dimensional State-Space Models With State Partition and Error Compensation

Bayesian Mixed-Frequency Quantile Vector Autoregression: Eliciting tail risks of Monthly US GDP

Nonparametric Bayesian estimation in a multidimensional diffusion model with high frequency data

Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based Models

Bayesian Multisource Hierarchical Models with Applications to the Monthly Retail Trade Survey

Sequential Bayesian Analysis of Time-Changed Infinite Activity Derivatives Pricing Models

State Estimation for Nonlinear Discrete-Time Fractional Systems: A Bayesian Perspective

A Noisy Fractional Brownian Motion Model for Multiscale Correlation Analysis of High-Frequency Prices

Bayesian inference for aggregated Hawkes processes