Moore: Interval Arithmetic in Modern C++

Walter F. Mascarenhas

DOI: https://doi.org/10.48550/arXiv.1611.09567

2016-11-29

Mathematical Software

Abstract:We present the library Moore, which implements Interval Arithmetic in modern C++. This library is based on a new feature in the C++ language called concepts, which reduces the problems caused by template meta programming, and leads to a new approach for implementing interval arithmetic libraries in C++.

What problem does this paper attempt to address?

Moore: Interval Arithmetic in C++20

Walter F. Mascarenhas

DOI: https://doi.org/10.48550/arXiv.1802.08558

2018-02-22

Abstract:This article presents the Moore library for interval arithmetic in C++20. It gives examples of how the library can be used, and explains the basic principles underlying its design.

Mathematical Software,Numerical Analysis
Modified Affine Arithmetic is More Accurate Than Centered Interval Arithmetic or Affine Arithmetic

Huahao Shou,Hongwei Lin,Ralph Martin,Guojin Wang

DOI: https://doi.org/10.1007/978-3-540-39422-8_23

2003-01-01

Abstract:In this paper we give mathematical proofs of two new results relevant to evaluating algebraic functions over a box-shaped region: (i) using interval arithmetic in centered form is always more accurate than standard affine arithmetic, and (ii) modified affine arithmetic is always more accurate than interval arithmetic in centered form. Test results show that modified affine arithmetic is not only more accurate but also much faster than standard affine arithmetic. We thus suggest that modified affine arithmetic is the method of choice for evaluating algebraic functions, such as implicit surfaces, over a box.
Interval iterative methods for computing Moore-Penrose inverse

Xian Zhang,Jianfeng Cai,Yimin Wei

DOI: https://doi.org/10.1016/j.amc.2006.05.098

IF: 4.397

2006-01-01

Applied Mathematics and Computation

Abstract:In this paper, we import interval method to the iteration for computing Moore-Penrose inverse of the full row (or column) rank matrix. Through modifying the classical Newton iteration by interval method, we can get better numerical results. The convergence of the interval iteration is proven. We also give some numerical examples to compare interval iteration with classical Newton iteration.
Arb: Efficient Arbitrary-Precision Midpoint-Radius Interval Arithmetic

Fredrik Johansson

DOI: https://doi.org/10.48550/arXiv.1611.02831

2016-11-09

Abstract:Arb is a C library for arbitrary-precision interval arithmetic using the midpoint-radius representation, also known as ball arithmetic. It supports real and complex numbers, polynomials, power series, matrices, and evaluation of many special functions. The core number types are designed for versatility and speed in a range of scenarios, allowing performance that is competitive with non-interval arbitrary-precision types such as MPFR and MPC floating-point numbers. We discuss the low-level number representation, strategies for precision and error bounds, and the implementation of efficient polynomial arithmetic with interval coefficients.

Mathematical Software,Symbolic Computation,Numerical Analysis
Computer-Assisted Verification of Four Interval Arithmetic Operators

Daisuke Ishii,Tomohito Yabu

DOI: https://doi.org/10.1016/j.cam.2020.112893

2020-04-09

Abstract:Interval arithmetic libraries provide the four elementary arithmetic operators for operand intervals bounded by floating-point numbers. Actual implementations need to make a large case analysis that considers, e.g., magnitude relations between all pairs of argument bounds, positional relations between the arguments and zero, and handling of the special values, infinities and NaN. Their correctness is not obvious as they are implemented by human hands, which comes to be critical for the reliability. This work provides a mechanically-verified interval arithmetic library. For this purpose, we utilize the Why3 platform equipped with a specification language for annotated programs and back-end theorem provers. We conduct several proof tasks for each of three properties of the target code: validity, soundness, and tightness; zero division exception handling is also verified for the division code. To accomplish the proof, we propose several techniques for specification/verification. First, we specify additional lemmas that support deductions made by back-end SMT solvers, which enable to discharge proof obligations in floating-point arithmetic containing nonlinear terms. Second, we examine the annotation of tightness, which requires to assume that a computation may result in NaN; we propose specific extremum operators for this purpose. In the experiments, applying the techniques in conjunction with the Alt-Ergo SMT solver and the Coq proof assistant proved the entire code.

Logic in Computer Science
Polyarc bounded complex interval arithmetic

Gábor Geréb,András Sándor

2024-02-18

Abstract:Complex interval arithmetic is a powerful tool for the analysis of computational errors. The naturally arising rectangular, polar, and circular (together called primitive) interval types are not closed under simple arithmetic operations, and their use yields overly relaxed bounds. The later introduced polygonal type, on the other hand, allows for arbitrarily precise representation of the above operations for a higher computational cost. We propose the polyarcular interval type as an effective extension of the previous types. The polyarcular interval can represent all primitive intervals and most of their arithmetic combinations precisely and has an approximation capability competing with that of the polygonal interval. In particular, in antenna tolerance analysis it can achieve perfect accuracy for lower computational cost then the polygonal type, which we show in a relevant case study. In this paper, we present a rigorous analysis of the arithmetic properties of all five interval types, involving a new algebro-geometric method of boundary analysis.

Numerical Analysis,Algebraic Geometry
Vc: A C++ library for explicit vectorization

Matthias Kretz,Volker Lindenstruth

DOI: https://doi.org/10.1002/spe.1149

2011-12-08

Abstract:It is an established trend that CPU development takes advantage of Moore's Law to improve in parallelism much more than in scalar execution speed. This results in higher hardware thread counts (MIMD) and improved vector units (SIMD), of which the MIMD developments have received the focus of library research and development in recent years. To make use of the latest hardware improvements, SIMD must receive a stronger focus of API research and development because the computational power can no longer be neglected and often auto‐vectorizing compilers cannot generate the necessary SIMD code, as will be shown in this paper. Nowadays, the SIMD capabilities are sufficiently significant to warrant vectorization of algorithms requiring more conditional execution than was originally expected for Streaming SIMD Extension to handle. The Vc library (http://compeng.uni‐frankfurt.de/?vc) was designed to support developers in the creation of portable vectorized code. Its capabilities and performance have been thoroughly tested. Vc provides portability of the source code, allowing full utilization of the hardware's SIMD capabilities, without introducing any overhead. Copyright © 2011 John Wiley & Sons, Ltd.

computer science, software engineering
Separation of concerning things: a simpler basis for defining and programming with the C/C++ memory model (extended version)

Robert J. Colvin

DOI: https://doi.org/10.48550/arXiv.2204.03189

2022-04-07

Programming Languages

Abstract:The C/C++ memory model provides an interface and execution model for programmers of concurrent (shared-variable) code. It provides a range of mechanisms that abstract from underlying hardware memory models -- that govern how multicore architectures handle concurrent accesses to main memory -- as well as abstracting from compiler transformations. The C standard describes the memory model in terms of cross-thread relationships between events, and has been influenced by several research works that are similarly based. In this paper we provide a thread-local definition of the fundamental principles of the C memory model, which, for concise concurrent code, serves as a basis for relatively straightforward reasoning about the effects of the C ordering mechanisms. We argue that this definition is more practical from a programming perspective and is amenable to analysis by already established techniques for concurrent code. The key aspect is that the memory model definition is separate to other considerations of a rich programming language such as C, in particular, expression evaluation and optimisations, though we show how to reason about those considerations in the presence of C concurrency. A major simplification of our framework compared to the description in the C standard and related work in the literature is separating out considerations around the "lack of multicopy atomicity", a concept that is in any case irrelevant to developers of code for x86, Arm, RISC-V or SPARC architectures. We show how the framework is convenient for reasoning about well-structured code, and for formally addressing unintuitive behaviours such as "out-of-thin-air" writes.
A variant of the Bombieri-Vinogradov theorem in short intervals with applications

Jesse Thorner

DOI: https://doi.org/10.48550/arXiv.1405.5486

2014-05-21

Number Theory

Abstract:We generalize the classical Bombieri-Vinogradov theorem to a short interval, non-abelian setting. This leads to variants of the prime number theorem for short intervals where the primes lie in arithmetic progressions that are "twisted" by a splitting condition in a Galois extension $L/K$ of number fields. Using this result in conjunction with recent work of Maynard, we prove that rational primes in short intervals with a given splitting condition in a Galois extension $L/\mathbb{Q}$ exhibit dense clusters in short intervals. We explore several arithmetic applications related to questions of Serre regarding the nonvanishing Fourier coefficients of cuspidal modular forms, including finding dense clusters of fundamental discriminants $ d $ in short intervals for which the central values of $d$-quadratic twists of modular $L$-functions are non-vanishing.
The Octagon Abstract Domain

Antoine Miné

DOI: https://doi.org/10.48550/arXiv.cs/0703084

2007-03-16

Abstract:This article presents a new numerical abstract domain for static analysis by abstract interpretation. It extends a former numerical abstract domain based on Difference-Bound Matrices and allows us to represent invariants of the form (+/-x+/-y<=c), where x and y are program variables and c is a real constant. We focus on giving an efficient representation based on Difference-Bound Matrices - O(n2) memory cost, where n is the number of variables - and graph-based algorithms for all common abstract operators - O(n3) time cost. This includes a normal form algorithm to test equivalence of representation and a widening operator to compute least fixpoint approximations.

Programming Languages
Compiling a Calculus for Relaxed Memory: Practical constraint-based low-level concurrency

Michael J. Sullivan,Karl Crary,Salil Joshi

DOI: https://doi.org/10.48550/arXiv.1904.05389

2019-04-11

Abstract:Crary and Sullivan's Relaxed Memory Calculus (RMC) proposed a new declarative approach for writing low-level shared memory concurrent programs in the presence of modern relaxed-memory multi-processor architectures and optimizing compilers. In RMC, the programmer explicitly specifies constraints on the order of execution of operations and on the visibility of memory writes. These constraints are then enforced by the compiler, which has a wide degree of latitude in how to accomplish its goals. We present rmc-compiler, a Clang and LLVM-based compiler for RMC-extended C and C++. In addition to using barriers to enforce ordering, rmc-compiler can take advantage of control and data dependencies, something that is beyond the abilities of current C/C++ compilers. In rmc-compiler, RMC compilation is modeled as an SMT problem with a cost term; the solution with the minimum cost determines the compilation strategy. In testing on ARM and POWER devices, RMC performs quite well, with modest performance improvements relative to C++11 on most of our data structure benchmarks and (on some architectures) dramatic improvements on a read-mostly list test that heavily benefits from use of data dependencies for ordering.

Programming Languages
About the ''accurate mode'' of the IEEE 1788-2015 standard for interval arithmetic

Nathalie Revol

2023-08-21

Abstract:The IEEE 1788-2015 standard for interval arithmetic defines three accuracy modes for the so-called set-based flavor: tightest, accurate and valid. This work in progress focuses on the accurate mode.First, an introduction to interval arithmetic and to the IEEE 1788-2015 standard is given, then the accurate mode is defined. How can this accurate mode be tested, when a library implementing interval arithmetic claims to provide this mode? The chosen approach is unit testing, and the elaboration of testing pairs for this approach is developed.A discussion closes this paper: how can the tester be tested? And if we go to the roots of the subject, is the accurate mode really relevant or should it be dropped off in the next version of the standard?

Numerical Analysis
An extension of C++ with memory-centric specifications for HPC to reduce memory footprints and streamline MPI development

Pawel K. Radtke,Cristian G. Barrera-Hinojosa,Mladen Ivkovic,Tobias Weinzierl

2024-06-26

Abstract:The C++ programming language and its cousins lean towards a memory-inefficient storage of structs: The compiler inserts helper bits into the struct such that individual attributes align with bytes, and it adds additional bytes aligning attributes with cache lines, while it is not able to exploit knowledge about the range of integers, enums or bitsets to bring the memory footprint down. Furthermore, the language provides neither support for data exchange via MPI nor for arbitrary floating-point precision formats. If developers need to have a low memory footprint and MPI datatypes over structs which exchange only minimal data, they have to manipulate the data and to write MPI datatypes manually. We propose a C++ language extension based upon C++ attributes through which developers can guide the compiler what memory arrangements would be beneficial: Can multiple booleans be squeezed into one bit field, do floats hold fewer significant bits than in the IEEE standard, or does the code require a user-defined MPI datatype for certain subsets of attributes? The extension offers the opportunity to fall back to normal alignment and padding rules via plain C++ assignments, no dependencies upon external libraries are introduced, and the resulting code remains standard C++. Our work implements the language annotations within LLVM and demonstrates their potential impact, both upon the runtime and the memory footprint, through smoothed particle hydrodynamics (SPH) benchmarks. They uncover the potential gains in terms of performance and development productivity.

Mathematical Software
Non-traditional intervals and their use. Which ones really make sense?

Sergey P. Shary

DOI: https://doi.org/10.48550/arXiv.2202.03058

2022-03-16

Abstract:The paper discusses the question of why intervals, which are the main object of Interval Analysis, have exactly the form that we know well and habitually use, and not some other. In particular, we investigate why traditional intervals are closed, i.\,e. contain their endpoints, and also what is wrong with an empty interval. The second question considered in the work is how expedient it is to expand the set of traditional intervals by some other objects. We show that improper ("reversed") intervals and the arithmetic of such intervals (Kaucher complete interval arithmetic) are very useful from many different points of view.

Numerical Analysis
On Faster Integer Calculations using Non-Arithmetic Primitives

Katharina Lürwer-Brüggemeier,Martin Ziegler

DOI: https://doi.org/10.48550/arXiv.0709.0624

2007-09-05

Abstract:The unit cost model is both convenient and largely realistic for describing integer decision algorithms over (+,*). Additional operations like division with remainder or bitwise conjunction, although equally supported by computing hardware, may lead to a considerable drop in complexity. We show a variety of concrete problems to benefit from such NON-arithmetic primitives by presenting and analyzing corresponding fast algorithms.

Data Structures and Algorithms
Real Solution Isolation Using Interval Arithmetic

Bican Xia,Ting Zhang

DOI: https://doi.org/10.1016/j.camwa.2006.06.003

IF: 3.218

2006-01-01

Computers & Mathematics with Applications

Abstract:We propose a complete algorithm for real solution isolation for semialgebraic systems by using interval arithmetic. The algorithm is implemented as a Maple program Nrealzero and its performance on several examples is reported.
Numerical Reproducibility and Parallel Computations: Issues for Interval Algorithms

Nathalie Revol,Philippe Théveny

DOI: https://doi.org/10.1109/TC.2014.2322593

2013-12-12

Abstract:What is called "numerical reproducibility" is the problem of getting the same result when the scientific computation is run several times, either on the same machine or on different machines, with different types and numbers of processing units, execution environments, computational loads etc. This problem is especially stringent for HPC numerical simulations. In what follows, the focus is on parallel implementations of interval arithmetic using floating-point arithmetic. For interval computations, numerical reproducibility is of course an issue for testing and debugging purposes. However, as long as the computed result encloses the exact and unknown result, the inclusion property, which is the main property of interval arithmetic, is satisfied and getting bit for bit identical results may not be crucial. Still, implementation issues may invalidate the inclusion property. Several ways to preserve the inclusion property are presented, on the example of the product of matrices with interval coefficients.

Numerical Analysis,Distributed, Parallel, and Cluster Computing
Compiling with Continuations and LLVM

Kavon Farvardin,John Reppy

DOI: https://doi.org/10.4204/EPTCS.285.5

2018-12-31

Abstract:LLVM is an infrastructure for code generation and low-level optimizations, which has been gaining popularity as a backend for both research and industrial compilers, including many compilers for functional languages. While LLVM provides a relatively easy path to high-quality native code, its design is based on a traditional runtime model which is not well suited to alternative compilation strategies used in high-level language compilers, such as the use of heap-allocated continuation closures. This paper describes a new LLVM-based backend that supports heap-allocated continuation closures, which enables constant-time callcc and very-lightweight multithreading. The backend has been implemented in the Parallel ML compiler, which is part of the Manticore system, but the results should be useful for other compilers, such as Standard ML of New Jersey, that use heap-allocated continuation closures.

Programming Languages
Target-Aware Implementation of Real Expressions

Brett Saiki,Jackson Brough,Jonas Regehr,Jesús Ponce,Varun Pradeep,Aditya Akhileshwaran,Zachary Tatlock,Pavel Panchekha

2024-11-01

Abstract:New low-precision accelerators, vector instruction sets, and library functions make maximizing accuracy and performance of numerical code increasingly challenging. Two lines of work$\unicode{x2013}$traditional compilers and numerical compilers$\unicode{x2013}$attack this problem from opposite directions. Traditional compiler backends optimize for specific target environments but are limited in their ability to balance performance and accuracy. Numerical compilers trade off accuracy and performance, or even improve both, but ignore the target environment. We join aspects of both to produce Chassis, a target-aware numerical compiler. Chassis compiles mathematical expressions to operators from a target description, which lists the real expressions each operator approximates and estimates its cost and accuracy. Chassis then uses an iterative improvement loop to optimize for speed and accuracy. Specifically, a new instruction selection modulo equivalence algorithm efficiently searches for faster target-specific programs, while a new cost-opportunity heuristic supports iterative improvement. We demonstrate Chassis' capabilities on 9 different targets, including hardware ISAs, math libraries, and programming languages. Chassis finds better accuracy and performance trade-offs than both Clang (by 3.5x) or Herbie (by up to 2.0x) by leveraging low-precision accelerators, accuracy-optimized numerical helper functions, and library subcomponents.

Programming Languages
Truncated multiplication and batch software SIMD AVX512 implementation for faster Montgomery multiplications and modular exponentiation

Laurent-Stéphane Didier,Nadia Mrabet,Léa Glandus,Jean-Marc Robert

DOI: https://doi.org/10.62056/a3txl86bm

2024-10-18

Abstract:This paper presents software implementations of batch computations, dealing with multi-precision integer operations. In this work, we use the Single Instruction Multiple Data (SIMD) AVX512 instruction set of the x86-64 processors, in particular the vectorized fused multiplier-adder VPMADD52. We focus on batch multiplications, squarings, modular multiplications, modular squarings and constant time modular exponentiations of 8 values using a word-slicing storage. We explore the use of Schoolbook and Karatsuba approaches with operands up to 4108 and 4154 bits respectively. We also introduce a truncated multiplication that speeds up the computation of the Montgomery modular reduction in the context of software implementation. Our Truncated Montgomery modular multiplication improvement offers speed gains of almost 20 % over the conventional non-truncated versions. Compared to the state-of-the-art GMP and OpenSSL libraries, our speedup modular operations are more than 4 times faster. Compared to OpenSSL BN_mod_exp_mont_consttimex2 using AVX512 and madd52* (madd52hi or madd52lo) in 256-bit registers, in fixed-window exponentiations of sizes 1024 and 2048 , our 512-bit implementation provides speedups of respectively 1.75 and 1.38, while the 256-bit version speedups are 1.51 and 1.05 for 1024 and 2048 -bit sizes (batch of 4 values in this case).

Distributed, Parallel, and Cluster Computing

Moore: Interval Arithmetic in Modern C++

Moore: Interval Arithmetic in C++20

Modified Affine Arithmetic is More Accurate Than Centered Interval Arithmetic or Affine Arithmetic

Interval iterative methods for computing Moore-Penrose inverse

Arb: Efficient Arbitrary-Precision Midpoint-Radius Interval Arithmetic

Computer-Assisted Verification of Four Interval Arithmetic Operators

Polyarc bounded complex interval arithmetic

Vc: A C++ library for explicit vectorization

Separation of concerning things: a simpler basis for defining and programming with the C/C++ memory model (extended version)

A variant of the Bombieri-Vinogradov theorem in short intervals with applications

The Octagon Abstract Domain

Compiling a Calculus for Relaxed Memory: Practical constraint-based low-level concurrency

About the ''accurate mode'' of the IEEE 1788-2015 standard for interval arithmetic

An extension of C++ with memory-centric specifications for HPC to reduce memory footprints and streamline MPI development

Non-traditional intervals and their use. Which ones really make sense?

On Faster Integer Calculations using Non-Arithmetic Primitives

Real Solution Isolation Using Interval Arithmetic

Numerical Reproducibility and Parallel Computations: Issues for Interval Algorithms

Compiling with Continuations and LLVM

Target-Aware Implementation of Real Expressions

Truncated multiplication and batch software SIMD AVX512 implementation for faster Montgomery multiplications and modular exponentiation