Abstract:Scientific computing applications, such as computational fluid dynamics and climate modeling, typically rely on 64-bit double-precision floating-point operations, which are extremely costly in terms of computation, memory, and energy. While the machine learning community has successfully utilized low-precision computations, scientific computing remains cautious due to concerns about numerical stability. To tackle this long-standing challenge, we propose a novel approach to dynamically adjust the floating-point data precision at runtime, maintaining computational fidelity using lower bit widths. We first conduct a thorough analysis of data range distributions during scientific simulations to identify opportunities and challenges for dynamic precision adjustment. We then propose a runtime reconfigurable, flexible floating-point multiplier (R2F2), which automatically and dynamically adjusts multiplication precision based on the current operands, ensuring accurate results with lower bit widths. Our evaluation shows that 16-bit R2F2 significantly reduces error rates by 70.2\% compared to standard half-precision, with resource overhead ranging from a 5% reduction to a 7% increase and no latency overhead. In two representative scientific computing applications, R2F2, using 16 or fewer bits, can achieve the same simulation results as 32-bit precision, while standard half precision will fail. This study pioneers runtime reconfigurable arithmetic, demonstrating great potential to enhance scientific computing efficiency. Code available at <a class="link-external link-https" href="https://github.com/sharc-lab/R2F2" rel="external noopener nofollow">this https URL</a>.

Accelerated Multiple Precision Direct Method and Mixed Precision Iterative Refinement on Python Programming Environment

Acceleration of multiple precision matrix multiplication based on multi-component floating-point arithmetic using AVX2

Acceleration of complex matrix multiplication using arbitrary precision floating-point arithmetic

Precision-Aware Iterative Algorithms Based on Group-Shared Exponents of Floating-Point Numbers

Tuning Technique for Multiple Precision Dense Matrix Multiplication using Prediction of Computational Time

Parallelized Implementation of the Finite Particle Method for Explicit Dynamics in GPU

Accelerated Multiple Precision Matrix Multiplication using Strassen's Algorithm and Winograd's Variant

Acceleration of Multiple Precision Matrix Multiplication using Ozaki scheme

Performance evaluation of accelerated complex multiple-precision LU decomposition

Multi-Objective Optimization for Floating Point Mix-Precision Tuning

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

MFFT: A GPU Accelerated Highly Efficient Mixed-precision Large-scale FFT Framework

A method for accelerating low precision operations by sparse matrix multiplication

A Study of Mixed Precision Strategies for GMRES on GPUs

Exploring and Exploiting Runtime Reconfigurable Floating Point Precision in Scientific Computing: a Case Study for Solving PDEs

Efficient and portable acceleration of quantum chemical many-body methods in mixed floating point precision using OpenACC compiler directives

PAM: A Piecewise-Linearly-Approximated Floating-Point Multiplier with Unbiasedness and Configurability

Faster arbitrary-precision dot product and matrix multiplication

Automatic Search Guided Code Optimization Framework for Mixed-Precision Scientific Applications.

Accelerating 128-bit Floating-Point Matrix Multiplication on FPGAs

Numerical eigen-spectrum slicing, accurate orthogonal eigen-basis, and mixed-precision eigenvalue refinement using OpenMP data-dependent tasks and accelerator offload