Abstract:The quality of numerical computations can be measured through their forward error, for which finding good error bounds is challenging in general. For several algorithms and using stochastic rounding (SR), probabilistic analysis has been shown to be an effective alternative for obtaining tight error bounds. This analysis considers the distribution of errors and evaluates the algorithm's performance on average. Using martingales and the Azuma-Hoeffding inequality, it provides error bounds that are valid with a certain probability and in $\mathcal{O}(\sqrt{n}u)$ instead of deterministic worst-case bounds in $\mathcal{O}(nu)$, where $n$ is the number of operations and $u$ is the unit <a class="link-external link-http" href="http://roundoff.In" rel="external noopener nofollow">this http URL</a> this paper, we present a general method that automatically constructs a martingale for any computation scheme with multi-linear errors based on additions, subtractions, and multiplications. We apply this generalization to algorithms previously studied with SR, such as pairwise summation and the Horner algorithm, and prove equivalent results. We also analyze a previously unstudied algorithm, Karatsuba polynomial multiplication, which illustrates that the method can handle reused intermediate computations.

Computing the Sign of a Dot Product Sum

Computing the exact sign of sums of products with floating point arithmetic

Computing Method for Limit of a Sun Form

A New Distillation Algorithm for Floating-Point Summation.

Error Analysis of Sum-Product Algorithms under Stochastic Rounding

Deterministic and Probabilistic Error Bounds for Floating Point Summation Algorithms

Twofold fast summation

Line Segment Intersection Testing

Floating point numbers are real numbers

On the Sign Changes in A Weighted Divisor Problem

LIL and the Approximation of Rectangular Sums of B-valued Random Variables when Extreme Terms Are Excluded

Exploiting Data Representation for Fault Tolerance

Remainder Sign Analysis in Fixed-point Division

Fault-Tolerant Dot-Product Engines

A Note on Solving Real Linear Systems with the Complex Schur Decompositon

A novel implementation scheme for high area-efficient DCT based on signed stochastic computation

A low complexity floating-point complex multiplier with a three-term dot-product unit

Floating-point to Fixed-point Transformation Using Extreme Value Theory

Sum of digamma asymptotic error terms of an arithmetic series

A G ] 2 9 N ov 2 00 6 Obtaining Exact Value by Approximate Computations ∗

Effective Quadratic Error Bounds for Floating-Point Algorithms Computing the Hypotenuse Function