Abstract:We consider the constrained sampling problem where the goal is to sample from a target distribution $\pi(x)\propto e^{-f(x)}$ when $x$ is constrained to lie on a convex body $\mathcal{C}$. Motivated by penalty methods from continuous optimization, we propose penalized Langevin Dynamics (PLD) and penalized underdamped Langevin Monte Carlo (PULMC) methods that convert the constrained sampling problem into an unconstrained sampling problem by introducing a penalty function for constraint violations. When $f$ is smooth and gradients are available, we get $\tilde{\mathcal{O}}(d/\varepsilon^{10})$ iteration complexity for PLD to sample the target up to an $\varepsilon$-error where the error is measured in the TV distance and $\tilde{\mathcal{O}}(\cdot)$ hides logarithmic factors. For PULMC, we improve the result to $\tilde{\mathcal{O}}(\sqrt{d}/\varepsilon^{7})$ when the Hessian of $f$ is Lipschitz and the boundary of $\mathcal{C}$ is sufficiently smooth. To our knowledge, these are the first convergence results for underdamped Langevin Monte Carlo methods in the constrained sampling that handle non-convex $f$ and provide guarantees with the best dimension dependency among existing methods with deterministic gradient. If unbiased stochastic estimates of the gradient of $f$ are available, we propose PSGLD and PSGULMC methods that can handle stochastic gradients and are scaleable to large datasets without requiring Metropolis-Hasting correction steps. For PSGLD and PSGULMC, when $f$ is strongly convex and smooth, we obtain $\tilde{\mathcal{O}}(d/\varepsilon^{18})$ and $\tilde{\mathcal{O}}(d\sqrt{d}/\varepsilon^{39})$ iteration complexity in W2 distance. When $f$ is smooth and can be non-convex, we provide finite-time performance bounds and iteration complexity results. Finally, we illustrate the performance on Bayesian LASSO regression and Bayesian constrained deep learning problems.

Non-asymptotic estimates for accelerated high order Langevin Monte Carlo algorithms

Projected Langevin Monte Carlo algorithms in non-convex and super-linear setting

User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradient

Non-asymptotic convergence bounds for modified tamed unadjusted Langevin algorithm in non-convex setting

Sharp convergence rates for Langevin dynamics in the nonconvex setting

Nonasymptotic analysis of Stochastic Gradient Hamiltonian Monte Carlo under local conditions for nonconvex optimization

Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Sampling

Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited

Non-asymptotic entropic bounds for non-linear kinetic Langevin sampler with second-order splitting scheme

Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias

Parallelized Midpoint Randomization for Langevin Monte Carlo

Accelerated convergence to equilibrium and reduced asymptotic variance for Langevin dynamics using Stratonovich perturbations

An Improved Analysis of Langevin Algorithms with Prior Diffusion for Non-Log-Concave Sampling

Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev

Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlo

Mean-Square Analysis with An Application to Optimal Dimension Dependence of Langevin Monte Carlo

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms

Exponential speed up in Monte Carlo sampling through Radial Updates

Penalized Overdamped and Underdamped Langevin Monte Carlo Algorithms for Constrained Sampling

Convergence Of The Unadjusted Langevin Algorithm For Discontinuous Gradients