Abstract:Abstract Motivated by the advent of machine learning, the last few years have seen the return of hardware-supported low-precision computing. Computations with fewer digits are faster and more memory and energy efficient but can be extremely susceptible to rounding errors. As shown by recent studies into reduced-precision climate simulations, an application that can largely benefit from the advantages of low-precision computing is the numerical solution of partial differential equations (PDEs). However, a careful implementation and rounding error analysis are required to ensure that sensible results can still be obtained. In this paper we study the accumulation of rounding errors in the solution of the heat equation, a proxy for parabolic PDEs, via Runge–Kutta finite difference methods using round-to-nearest (RtN) and stochastic rounding (SR). We demonstrate how to implement the scheme to reduce rounding errors and we derive a priori estimates for local and global rounding errors. Let $u$ be the unit roundoff. While the worst-case local errors are $\mathcal{O}(u)$ with respect to the discretization parameters (mesh size and timestep), the RtN and SR error behaviour is substantially different. In fact, the RtN solution always stagnates for small enough $\varDelta t$, and until stagnation the global error grows like $\mathcal{O}(u\varDelta t^{-1})$. In contrast, we show that the leading-order errors introduced by SR are zero-mean, independent in space and mean-independent in time, making SR resilient to stagnation and rounding error accumulation. In fact, we prove that for SR the global rounding errors are only $\mathcal{O}(u\varDelta t^{-1/4})$ in one dimension and are essentially bounded (up to logarithmic factors) in higher dimensions.

A posteriori error analysis of round-off errors in the numerical solution of ordinary differential equations

Engineering Analysis Error Estimation when Removing Finite-Sized Features in Nonlinear Elliptic Problems.

A Posteriori Error Bounds and Global Error Control for Approximation of Ordinary Differential Equations

Explicit and implicit error inhibiting schemes with post-processing

Effects of round-to-nearest and stochastic rounding in the numerical solution of the heat equation in low precision

Two-sided a posteriori error estimates for linear elliptic problems with mixed boundary conditions

Probabilistic evolution of the error of numerical method for linear stochastic differential equation

A posteriori error analysis and adaptive non-intrusive numerical schemes for systems of random conservation laws

A posteriori error estimates for fourth-order elliptic problems

A pedagogical review on a posteriori error estimation in Finite Element computations

A-posteriori error estimates for systems of hyperbolic conservation laws

Theory of shifts, shocks, and the intimate connections to $L^2$-type a posteriori error analysis of numerical schemes for hyperbolic problems

Numerical method and Error estimate for stochastic Landau--Lifshitz--Bloch equation

A Posteriori Error Control for Fourth-Order Semilinear Problems with Quadratic Nonlinearity

Balancing Discretization and Iteration Error in Finite Element A Posteriori Error Analysis

Error estimation for numerical approximations of ODEs via composition techniques. Part I: One-step methods

A posteriori error estimates for Schr{ö}dinger operators discretized with linear combinations of atomic orbitals

Reliable numerical solution of a class of nonlinear elliptic problems generated by the Poisson-Boltzmann equation

A posteriori error estimates for the Brinkman-Darcy-Forchheimer problem

Influence of round-off errors on the reliability of numerical simulations of chaotic dynamic systems