Abstract:The unadjusted Langevin algorithm is commonly used to sample probability distributions in extremely high-dimensional settings. However, existing analyses of the algorithm for strongly log-concave distributions suggest that, as the dimension $d$ of the problem increases, the number of iterations required to ensure convergence within a desired error in the $W_2$ metric scales in proportion to $d$ or $\sqrt{d}$. In this paper, we argue that, despite this poor scaling of the $W_2$ error for the full set of variables, the behavior for a small number of variables can be significantly better: a number of iterations proportional to $K$, up to logarithmic terms in $d$, often suffices for the algorithm to converge to within a desired $W_2$ error for all $K$-marginals. We refer to this effect as delocalization of bias. We show that the delocalization effect does not hold universally and prove its validity for Gaussian distributions and strongly log-concave distributions with certain sparse interactions. Our analysis relies on a novel $W_{2,\ell^\infty}$ metric to measure convergence. A key technical challenge we address is the lack of a one-step contraction property in this metric. Finally, we use asymptotic arguments to explore potential generalizations of the delocalization effect beyond the Gaussian and sparse interactions setting.

Convergence of the Weighted Nonlocal Laplacian on Random Point Cloud

Error Estimation of Weighted Nonlocal Laplacian on Random Point Cloud

Weighted Nonlocal Laplacian on Interpolation from Sparse Data.

Generalization of the Weighted Nonlocal Laplacian in Low Dimensional Manifold Model

Local Linear M‐estimation in Non‐parametric Spatial Regression

Convergence of the Point Integral method for Poisson equation on point cloud

Convergence of Laplacian Spectra from Point Clouds

Convergence of Laplacian Spectra from Random Samples

Convergence of the Point Integral Method for Laplace–Beltrami Equation on Point Cloud

When Locally Linear Embedding Hits Boundary

LSPConv: local spatial projection convolution for point cloud analysis

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

A Non-Local Gradient Based Approach of Infinity Laplacian with Γ-convergence

On the Convergence of Random Fourier--Jacobi Series in weighted $\mathrm{L}_{[-1,1]}^{\mathrm{p},(ζ,η)}$ Space

Convergence and Uniqueness Properties of Gauss-Newton's Method

Weighted graph laplacian and image inpainting

Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias

Convergence of the Point Integral Method for the Poisson Equation with Dirichlet Boundary on Point Cloud

Convergence Rate Analysis in Limit Theorems for Nonlinear Functionals of the Second Wiener Chaos

Globally solving the Gromov-Wasserstein problem for point clouds in low dimensional Euclidean spaces

Law of the single logarithm for randomly weighted sums of dependent sequences and an application