Abstract:In this paper, we study numerical approximations for stochastic differential equations (SDEs) that use adaptive step sizes. In particular, we consider a general setting where decisions to reduce step sizes are allowed to depend on the future trajectory of the underlying Brownian motion. Since these adaptive step sizes may not be previsible, the standard mean squared error analysis cannot be directly applied to show that the numerical method converges to the solution of the SDE. Building upon the pioneering work of Gaines and Lyons, we instead use rough path theory to establish pathwise convergence for a wide class of adaptive numerical methods on general Stratonovich SDEs (with sufficiently smooth vector fields). To our knowledge, this is the first convergence guarantee that applies to standard solvers, such as the Milstein and Heun methods, with non-previsible step sizes. In our analysis, we require the sequence of adaptive step sizes to be nested and the SDE solver to have unbiased "Lévy area" terms in its Taylor expansion. We conjecture that for adaptive SDE solvers more generally, convergence is still possible provided the method does not introduce "Lévy area bias". We present a simple example where the step size control can skip over previously considered times, resulting in the numerical method converging to an incorrect limit (i.e. not the Stratonovich SDE). Finally, we conclude with an experiment demonstrating the accuracy of Heun's method and a newly introduced Splitting Path-based Runge-Kutta scheme (SPaRK) when used with adaptive step sizes.

Stochastic Fixed-Point Iterations for Nonexpansive Maps: Convergence and Error Bounds

Riemannian stochastic fixed point optimization algorithm

Quantitative statistical stability and convergence to equilibrium. An application to maps with indifferent fixed points

Bounded fixed point sets and Krasnoselskii iterates of Thompson metric nonexpansive maps

Revisiting Inexact Fixed-Point Iterations for Min-Max Problems: Stochasticity and Structured Nonconvexity

Stochastic Halpern iteration in normed spaces and applications to reinforcement learning

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds

New nonasymptotic convergence rates of stochastic proximal pointalgorithm for convex optimization problems

Stochastic proximal gradient methods for nonconvex problems in Hilbert spaces

Stochastic Convergence of Regularized Solutions and Their Finite Element Approximations to Inverse Source Problems

On Stochastic Stability of Expanding Circle Maps with Neutral Fixed Points

Exponential Concentration in Stochastic Approximation

Krasnoselskii-Mann Iterations: Inertia, Perturbations and Approximation

Concentration of Contractive Stochastic Approximation: Additive and Multiplicative Noise

Addendum: On stochastic Kaczmarz type methods for solving large scale systems of ill-posed equations (2022 Inverse Problems 38 025003)

Convergence of algorithms for fixed points of relatively nonexpansive mappings via Ishikawa iteration

Asymptotic regularity of a generalised stochastic Halpern scheme with applications

Tight Nonparametric Convergence Rates for Stochastic Gradient Descent under the Noiseless Linear Model

Inertial Krasnoselskii-Mann Iterations

On the convergence of adaptive approximations for stochastic differential equations