Abstract:ABSTRACTWriting reliable software is difficult. It becomes even more difficult when writing scientific software involving floating-point numbers. Computers provide numbers with limited precision; when confronted with a real whose precision exceeds that limit, they introduce approximation and error. Numerical analysts have developed sophisticated mathematical techniques for performing error and stability analysis of numerical algorithms. However, these are generally not accessible to application programmers or scientists who often do not have in-depth training in numerical analysis and who thus need more automated techniques to analyze their code. In this paper, we develop a novel, practical technique to help application programmers (or even numerical experts) obtain high-level information regarding the numerical stability and accuracy of their code. Our main insight is that by systematically altering (or perturbing) the underlying numerical calculation, we can uncover potential pitfalls in the numerical code. We propose two complementary perturbations to statistically measure numerical stability: value perturbation and expression perturbation. Value perturbation dynamically replaces the least significant bits of each floating-point value, including intermediate values, with random bits to statistically induce numerical error in the code. Expression perturbation statically changes the numerical expressions in the user program to mathematically equivalent (in the reals, likely not in floating-point numbers), but syntactically different forms. We then compare the executions of these "equivalent" forms to help discover and remedy potential instabilities. Value perturbation can overstate error, while expression perturbation is relatively conservative, so we use value perturbation to generate candidates for expression perturbation. We have implemented our technique, and evaluation results on various programs from the literature and the GNU Scientific Library (GSL) show that our technique is effective and offers a practical alternative for understanding numerical stability in scientific software.

Silent error detection in numerical time-stepping schemes

The Detection and Correction of Silent Errors in Pipelined Krylov Subspace Methods

Explicit and implicit error inhibiting schemes with post-processing

Program Instability Detection Based on Systematically Optimized Numerical Perturbation

A posteriori error analysis of round-off errors in the numerical solution of ordinary differential equations

Invariant preservation in machine learned PDE solvers via error correction

Perturbing numerical calculations for statistical analysis of floating-point program (in)stability.

Black Holes with Weyl Charge and Non-Riemannian Waves

Error analysis of a pressure correction method with explicit time stepping

Probabilistic evolution of the error of numerical method for linear stochastic differential equation

Robust data-driven discovery of governing physical laws with error bars

A Study of the Robustness of Iterative Methods for Linear Systems

Fully reliable error control for evolutionary problems

Algorithms that satisfy a stopping criterion, probably

On the stability analysis of numerical schemes for solving non-linear polynomials arises in engineering problems

The need for accuracy and smoothness in numerical simulations

Stochastic C-stability and B-consistency of explicit and implicit Euler-type schemes

Effects of round-to-nearest and stochastic rounding in the numerical solution of the heat equation in low precision

Parallel-in-Time Probabilistic Numerical ODE Solvers

Stability-Optimized High Order Methods and Stiffness Detection for Pathwise Stiff Stochastic Differential Equations

Error estimation for numerical approximations of ODEs via composition techniques. Part I: One-step methods