Abstract:ABSTRACTWriting reliable software is difficult. It becomes even more difficult when writing scientific software involving floating-point numbers. Computers provide numbers with limited precision; when confronted with a real whose precision exceeds that limit, they introduce approximation and error. Numerical analysts have developed sophisticated mathematical techniques for performing error and stability analysis of numerical algorithms. However, these are generally not accessible to application programmers or scientists who often do not have in-depth training in numerical analysis and who thus need more automated techniques to analyze their code. In this paper, we develop a novel, practical technique to help application programmers (or even numerical experts) obtain high-level information regarding the numerical stability and accuracy of their code. Our main insight is that by systematically altering (or perturbing) the underlying numerical calculation, we can uncover potential pitfalls in the numerical code. We propose two complementary perturbations to statistically measure numerical stability: value perturbation and expression perturbation. Value perturbation dynamically replaces the least significant bits of each floating-point value, including intermediate values, with random bits to statistically induce numerical error in the code. Expression perturbation statically changes the numerical expressions in the user program to mathematically equivalent (in the reals, likely not in floating-point numbers), but syntactically different forms. We then compare the executions of these "equivalent" forms to help discover and remedy potential instabilities. Value perturbation can overstate error, while expression perturbation is relatively conservative, so we use value perturbation to generate candidates for expression perturbation. We have implemented our technique, and evaluation results on various programs from the literature and the GNU Scientific Library (GSL) show that our technique is effective and offers a practical alternative for understanding numerical stability in scientific software.

Evaluation of Static Analysis Techniques for Fixed-Point Precision Optimization

Detecting and fixing precision-specific operations for measuring floating-point errors.

DESIGNING OPTIMIZED IMPRECISE FIXED-POINT ARITHMETIC CIRCUITS SPECIFIED BY POLYNOMIALS WITH VARIOUS CONSTRAINTS

Heterogeneous Static Timing Analysis with Advanced Delay Calculator

Sound Mixed-Precision Optimization with Rewriting

Energy and Error Reduction using Variable Bit-width Optimization on Dynamic Fixed Point Format

Floating-point to Fixed-point Transformation Using Extreme Value Theory

Detecting Floating-Point Errors via Atomic Conditions

Analysis of Floating-Point Arithmetic Accuracy in Aero-Engine FADEC System Software

Automatic Numerical Analysis Based on Infinite-Precision Arithmetic

Analysis and Optimization for Hardware Implementation of Sine/cosine with Faithful Rounding and Monotonicity Through Piecewise Quadratic Polynomial

Multi-Objective Optimization for Floating Point Mix-Precision Tuning

An Experience-Guided Acceleration Strategy for Floating-Point Optimization

Perturbing numerical calculations for statistical analysis of floating-point program (in)stability.

The Impact of Profiling Versus Static Analysis in Precision Tuning

A Genetic Algorithm for Detecting Significant Floating-Point Inaccuracies

Tradeoff Between Approximation Accuracy and Complexity for Range Analysis Using Affine Arithmetic

Precision-Aware Iterative Algorithms Based on Group-Shared Exponents of Floating-Point Numbers

Combining Tools for Optimization and Analysis of Floating-Point Computations

The pitfalls of verifying floating-point computations

Evaluating Design Tradeoffs in Numeric Static Analysis for Java