Abstract:ABSTRACTWriting reliable software is difficult. It becomes even more difficult when writing scientific software involving floating-point numbers. Computers provide numbers with limited precision; when confronted with a real whose precision exceeds that limit, they introduce approximation and error. Numerical analysts have developed sophisticated mathematical techniques for performing error and stability analysis of numerical algorithms. However, these are generally not accessible to application programmers or scientists who often do not have in-depth training in numerical analysis and who thus need more automated techniques to analyze their code. In this paper, we develop a novel, practical technique to help application programmers (or even numerical experts) obtain high-level information regarding the numerical stability and accuracy of their code. Our main insight is that by systematically altering (or perturbing) the underlying numerical calculation, we can uncover potential pitfalls in the numerical code. We propose two complementary perturbations to statistically measure numerical stability: value perturbation and expression perturbation. Value perturbation dynamically replaces the least significant bits of each floating-point value, including intermediate values, with random bits to statistically induce numerical error in the code. Expression perturbation statically changes the numerical expressions in the user program to mathematically equivalent (in the reals, likely not in floating-point numbers), but syntactically different forms. We then compare the executions of these "equivalent" forms to help discover and remedy potential instabilities. Value perturbation can overstate error, while expression perturbation is relatively conservative, so we use value perturbation to generate candidates for expression perturbation. We have implemented our technique, and evaluation results on various programs from the literature and the GNU Scientific Library (GSL) show that our technique is effective and offers a practical alternative for understanding numerical stability in scientific software.

On numerical stability of recursive present value computation method

A Further Analysis of Backward Error in Polynomial Deflation

Numerical Algorithms for Panjer Recursion by Applying Bernstein Approximation

Detecting Potential Instabilities of Numerical Algorithms

Computing Dsge Models with Recursive Preferences and Stochastic Volatility

The improvement of the truncated Euler-Maruyama method for non-Lipschitz stochastic differential equations

On Lyapunov Stability of Positive and Conservative Time Integrators and Application to Second Order Modified Patankar--Runge--Kutta Schemes

Numerical treatment to a non-local parabolic free boundary problem arising in financial bubbles

A Compensated Numerical Method for Solving Stochastic Differential Equations with Variable Delays and Random Jump Magnitudes

STABILIZED NUMERICAL APPROXIMATIONS OF THE BACKWARD PROBLEM OF A PARABOLIC EQUATION

Positivity-preserving truncated Euler and Milstein methods for financial SDEs with super-linear coefficients

Perturbing numerical calculations for statistical analysis of floating-point program (in)stability.

Exponential Stability and Numerical Methods of Stochastic Recurrent Neural Networks with Delays

Analysis of error propagation in the RK3GL2 method

A positivity-preserving numerical scheme for option pricing model with transaction costs under jump-diffusion process

On The Stability Analysis And Numerical Dynamics Of The Nonlinear Black–Scholes Equation In Conformable Arising In Economy

Numerical Instability of Algebraic Rootfinding Methods

Numerical Stability for Differential Equations with Memory

Stochastic C-stability and B-consistency of explicit and implicit Euler-type schemes

Numerical schemes for hyperbolic conservation laws with stiff relaxation terms

An Asymptotic Method to a Financial Optimization Problem