Theory and Algorithms for Diffusion Processes on Riemannian Manifolds

Xiang Cheng,Jingzhao Zhang,Suvrit Sra
DOI: https://doi.org/10.48550/arXiv.2204.13665
2023-11-21
Abstract:We study geometric stochastic differential equations (SDEs) and their approximations on Riemannian manifolds. In particular, we introduce a simple new construction of geometric SDEs, using which with bounded curvature. In particular, we provide the first (to our knowledge) non-asymptotic bound on the error of the geometric Euler-Murayama discretization. We then bound the distance between the exact SDE and a discrete geometric random walk, where the noise can be non-Gaussian; this analysis is useful for using geometric SDEs to model naturally occurring discrete non-Gaussian stochastic processes. Our results provide convenient tools for studying MCMC algorithms that adopt non-standard noise distributions.
Probability,Differential Geometry
What problem does this paper attempt to address?
This paper aims to solve the following problems: 1. **Quantifying the Euler - Murayama discretization error in geometry**: The author attempts to quantify the error when using the geometric Euler - Murayama scheme to discretize stochastic differential equations (SDEs) on Riemannian manifolds, especially the relationship between the step size \(\delta\) and the intrinsic properties of the manifold (such as curvature). Specifically, they hope to provide a non - asymptotic error bound to ensure the closeness of the discretization process to the actual SDE. 2. **Extending the discretization method to non - Gaussian noise**: Besides the standard Gaussian noise, the author also studies how to handle the discretization methods with non - Gaussian, position - dependent noise. These methods can more accurately simulate the complex random processes occurring in nature and may be more computationally advantageous. ### Main Objectives and Contributions #### Objective I: Geometric Euler - Murayama Discretization Error The author's objective is to quantify the discretization error of the geometric Euler - Murayama scheme (1.2), especially the influence of the step size \(\delta\) and the intrinsic properties of the manifold (such as curvature) on the error. Their main theoretical contributions include: - **Constructing the exact SDE**: Through a series of increasingly refined Euler - Murayama sequences, the author constructs the limit form of SDE (1.1). These sequences, through carefully designed coupling methods, ensure that the trajectories (1.2) are approximately parallel to SDE (1.1) in a short time. - **Single - step error analysis**: Using the above construction, the author proves that the error between the one - step Euler - Murayama discretization (1.2) and SDE (1.1) within the time interval \(\delta\) is \(O(\delta^{3/2})\), which is consistent with the one - step Euler - Murayama error in Euclidean space. - **Global error bound**: In Theorem 1, the author provides the \(W_1\) - distance bound between SDE (1.1) and the Euler - Murayama scheme for all times \(t\). To sample from the distribution such that the distribution is close to the invariant distribution of SDE (1.1), Theorem 1 requires \(\tilde{O}(\epsilon^{-2})\) steps, which matches the optimal iterative complexity of Langevin MCMC in Euclidean space. #### Objective II: Extension to Non - Gaussian Noise The author further extends the above error bound to stochastic processes with non - Gaussian noise: \[ x_{k + 1}=\exp_{x_k}(-\delta\beta(x_k)+\sqrt{\delta}\xi_k(x_k)) \] where \(\xi_k\) is an independently and identically distributed random vector field. The author hopes to understand this process and its approximation effect on SDE (1.1). The main motivation is that this non - Gaussian noise can capture certain naturally occurring random processes and may be more computationally advantageous than the geometric Euler - Murayama scheme. ### Theoretical Contributions - **Error bound**: The author provides the \(W_1\) - distance bound between the K - step non - Gaussian noise discretization (1.3) and SDE (1.1) within the time interval \(K\delta\) (Lemma 5). Specifically, if \(x(t)\) is as shown in (1.1), and \(\{x_k\}_k\) is the discrete sequence obtained through (1.3), then Lemma 5 shows that for a sufficiently large K, \[ E[d(x(K\delta),x_K)]\leq\tilde{O}(\delta^{1/6}) \] - **Extension of the central limit theorem**: The author also proves an extended version of a classical quantitative central limit theorem, and this result is used to control the error of non - Gaussian noise discretization. In conclusion, through rigorous mathematical analysis, this paper provides non - asymptotic bounds for the discretization error of geometric SDEs on Riemannian manifolds and extends it to the case of non - Gaussian noise, providing new tools and insights for the design and analysis of MCMC algorithms.