Abstract:ABSTRACTWriting reliable software is difficult. It becomes even more difficult when writing scientific software involving floating-point numbers. Computers provide numbers with limited precision; when confronted with a real whose precision exceeds that limit, they introduce approximation and error. Numerical analysts have developed sophisticated mathematical techniques for performing error and stability analysis of numerical algorithms. However, these are generally not accessible to application programmers or scientists who often do not have in-depth training in numerical analysis and who thus need more automated techniques to analyze their code. In this paper, we develop a novel, practical technique to help application programmers (or even numerical experts) obtain high-level information regarding the numerical stability and accuracy of their code. Our main insight is that by systematically altering (or perturbing) the underlying numerical calculation, we can uncover potential pitfalls in the numerical code. We propose two complementary perturbations to statistically measure numerical stability: value perturbation and expression perturbation. Value perturbation dynamically replaces the least significant bits of each floating-point value, including intermediate values, with random bits to statistically induce numerical error in the code. Expression perturbation statically changes the numerical expressions in the user program to mathematically equivalent (in the reals, likely not in floating-point numbers), but syntactically different forms. We then compare the executions of these "equivalent" forms to help discover and remedy potential instabilities. Value perturbation can overstate error, while expression perturbation is relatively conservative, so we use value perturbation to generate candidates for expression perturbation. We have implemented our technique, and evaluation results on various programs from the literature and the GNU Scientific Library (GSL) show that our technique is effective and offers a practical alternative for understanding numerical stability in scientific software.

Dissipative Arithmetic

Failed Disruption Propagation in Integer Genetic Programming

Deep imperative mutations have less impact

Open to Evolve Embodied Intelligence

Scaling Integer Arithmetic in Probabilistic Programs

Automatic Repair of Overflowing Expressions with Abstract Interpretation

Resilience in Numerical Methods: A Position on Fault Models and Methodologies

Perturbing numerical calculations for statistical analysis of floating-point program (in)stability.

Promise Algebra: An Algebraic Model of Non-Deterministic Computations

Simplified High Level Parallelism Expression on Heterogeneous Systems Through Data Partition Pattern Description.

Continuation-Passing Style, Defunctionalization, Accumulations, and Associativity

Fibred Computational Effects

Software Engineering and Complexity in Effective Algebraic Geometry

Modular programming of computing media using spatial types, for artificial physics

Beyond the elementary representations of program invariants over algebraic data types

Generalizing Permissive-Upgrade in Dynamic Information Flow Analysis

Algebraic program semantics for supercomputing

Diffusive stability of Turing patterns via normal forms

Abstracting Abstract Machines: A Systematic Approach to Higher-Order Program Analysis

High-precision computation: Mathematical physics and dynamics

Dissipation as a resource for Quantum Reservoir Computing