Abstract:Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two estimators of linear functionals of $\mu_\phi $ based on the discretized Markov process are considered: a time-averaging estimator based on a single trajectory and an ensemble-averaging estimator based on multiple independent trajectories. Imposing no restrictions beyond a nominal level of smoothness on $\phi$, first-order error bounds, in discretization step size, on the bias and variance/mean-square error of both estimators are derived. The order of error matches the optimal rate in Euclidean and flat spaces, and leads to a first-order bound on distance between the invariant measure $\mu_\phi$ and a stationary measure of the discretized Markov process. This order is preserved even upon using retractions when exponential maps are unavailable in closed form, thus enhancing practicality of the proposed algorithms. Generality of the proof techniques, which exploit links between two partial differential equations and the semigroup of operators corresponding to the Langevin diffusion, renders them amenable for the study of a more general class of sampling algorithms related to the Langevin diffusion. Conditions for extending analysis to the case of non-compact manifolds are discussed. Numerical illustrations with distributions, log-concave and otherwise, on the manifolds of positive and negative curvature elucidate on the derived bounds and demonstrate practical utility of the sampling algorithm.

Generalizing the No-U-Turn Sampler to Riemannian Manifolds

The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo

On the convergence of dynamic implementations of Hamiltonian Monte Carlo and No U-Turn Samplers

Adaptive Hamiltonian and Riemann Manifold Monte Carlo Samplers

ATLAS: Adapting Trajectory Lengths and Step-Size for Hamiltonian Monte Carlo

Monte Carlo on Manifolds: Sampling Densities and Integrating Functions

Antithetic Riemannian Manifold And Quantum-Inspired Hamiltonian Monte Carlo

Lagrangian Dynamical Monte Carlo

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler Without Accept/Reject

Efficient Sampling on Riemannian Manifolds via Langevin MCMC

GIST: Gibbs self-tuning for locally adaptive Hamiltonian Monte Carlo

Mixing of the No-U-Turn Sampler and the Geometry of Gaussian Concentration

Sampling and estimation on manifolds using the Langevin diffusion

Robust Inference Based on the Complementary Hamiltonian Monte Carlo

Multi-fidelity No-U-Turn Sampling

Optimization on manifolds: A symplectic approach

Sampling with Barriers: Faster Mixing via Lewis Weights

The Geometry of Hamiltonian Monte Carlo

A Riemannian Gradient Sampling Algorithm for Nonsmooth Optimization on Manifolds

Incorporating Local Step-Size Adaptivity into the No-U-Turn Sampler using Gibbs Self Tuning