Abstract:ABSTRACTWriting reliable software is difficult. It becomes even more difficult when writing scientific software involving floating-point numbers. Computers provide numbers with limited precision; when confronted with a real whose precision exceeds that limit, they introduce approximation and error. Numerical analysts have developed sophisticated mathematical techniques for performing error and stability analysis of numerical algorithms. However, these are generally not accessible to application programmers or scientists who often do not have in-depth training in numerical analysis and who thus need more automated techniques to analyze their code. In this paper, we develop a novel, practical technique to help application programmers (or even numerical experts) obtain high-level information regarding the numerical stability and accuracy of their code. Our main insight is that by systematically altering (or perturbing) the underlying numerical calculation, we can uncover potential pitfalls in the numerical code. We propose two complementary perturbations to statistically measure numerical stability: value perturbation and expression perturbation. Value perturbation dynamically replaces the least significant bits of each floating-point value, including intermediate values, with random bits to statistically induce numerical error in the code. Expression perturbation statically changes the numerical expressions in the user program to mathematically equivalent (in the reals, likely not in floating-point numbers), but syntactically different forms. We then compare the executions of these "equivalent" forms to help discover and remedy potential instabilities. Value perturbation can overstate error, while expression perturbation is relatively conservative, so we use value perturbation to generate candidates for expression perturbation. We have implemented our technique, and evaluation results on various programs from the literature and the GNU Scientific Library (GSL) show that our technique is effective and offers a practical alternative for understanding numerical stability in scientific software.

On The Robustness Of Numerical Algorithms For Linear Systems And Signal Processing In Finite Precision Arithmetic

A Study of the Robustness of Iterative Methods for Linear Systems

A Comparative Study on Algorithms of Robust and Stochastic MPC for Uncertain Systems

Automatic Numerical Analysis Based on Infinite-Precision Arithmetic

A Direct Coupled Solution Methodology for Efficient Robust Optimizations of Inverse Problems under Uncertainty

Perturbing numerical calculations for statistical analysis of floating-point program (in)stability.

Optimal Controller And Filter Realizations Using Finite-Precision, Floating-Point Arithmetic

Program Instability Detection Based on Systematically Optimized Numerical Perturbation

Resilience in Numerical Methods: A Position on Fault Models and Methodologies

High-precision computation: Mathematical physics and dynamics

Algorithms and data structures for numerical computations with automatic precision estimation

Robust Performance of Systems with Structured Uncertainties in State Space

On the precision attainable with various floating-point number systems

Robust Stability and Performance of Uncertain Systems in State Space

Modeling still matters: a surprising instance of catastrophic floating point errors in mathematical biology and numerical methods for ODEs

Inexactness and Correction of Floating-Point Reciprocal, Division and Square Root

Computation Of Perturbation Bound For A Class Of Uncertain Nonlinear Systems Guaranteeing Global Convergence

Robust stability of fractional-order systems with mixed uncertainties: The 0 < α < 1 case

On the Robust Stability Analysis with Real Block Structured Uncertainties.

Robust Numerical Methods for Nonlinear Regression

Robust stabilization of uncertain linear systems: quadratic stabilizability and H/sup infinity / control theory