Abstract:In this paper, we study numerical approximations for stochastic differential equations (SDEs) that use adaptive step sizes. In particular, we consider a general setting where decisions to reduce step sizes are allowed to depend on the future trajectory of the underlying Brownian motion. Since these adaptive step sizes may not be previsible, the standard mean squared error analysis cannot be directly applied to show that the numerical method converges to the solution of the SDE. Building upon the pioneering work of Gaines and Lyons, we instead use rough path theory to establish pathwise convergence for a wide class of adaptive numerical methods on general Stratonovich SDEs (with sufficiently smooth vector fields). To our knowledge, this is the first convergence guarantee that applies to standard solvers, such as the Milstein and Heun methods, with non-previsible step sizes. In our analysis, we require the sequence of adaptive step sizes to be nested and the SDE solver to have unbiased "Lévy area" terms in its Taylor expansion. We conjecture that for adaptive SDE solvers more generally, convergence is still possible provided the method does not introduce "Lévy area bias". We present a simple example where the step size control can skip over previously considered times, resulting in the numerical method converging to an incorrect limit (i.e. not the Stratonovich SDE). Finally, we conclude with an experiment demonstrating the accuracy of Heun's method and a newly introduced Splitting Path-based Runge-Kutta scheme (SPaRK) when used with adaptive step sizes.

Adaptive Step Size for Hybrid Monte Carlo Algorithm

Self-Tuning Hamiltonian Monte Carlo for Accelerated Sampling

Numerical Integrators for the Hybrid Monte Carlo Method

Adaptive stepsize algorithms for Langevin dynamics

A Hybrid Stochastic Gradient Hamiltonian Monte Carlo Method

AutoStep: Locally adaptive involutive MCMC

Adaptive Monte Carlo methods for matrix equations with applications

Variable Step Size Methods of the Hybrid Affine Projection Adaptive Filtering Algorithm under Symmetrical Non-Gaussian Noise

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent

Adaptive step-size selection for state-space probabilistic differential equation solvers

On the convergence of adaptive approximations for stochastic differential equations

An Application of the Hybrid Monte Carlo Algorithm for Realized Stochastic Volatility Model

Stochastic Primal–Dual Hybrid Gradient Algorithm with Adaptive Step Sizes

Adaptive Step-Size for Online Temporal Difference Learning

An Improved Acceptance Procedure for the Hybrid Monte Carlo Algorithm

Stochastic Primal Dual Hybrid Gradient Algorithm with Adaptive Step-Sizes

Notes on the Hybrid Monte Carlo Method

Adaptive timestepping strategies for nonlinear stochastic systems

The role of adaptivity in a numerical method for the Cox-Ingersoll-Ross model

Markov Chain Analysis of Cumulative Step-size Adaptation on a Linear Constrained Problem

On a variable step size modification of Hines' method in computational neuroscience