Abstract:Advancements in computer hardware have made it possible to utilize low- and mixed-precision arithmetic for enhanced computational efficiency. In practical predictive modeling, however, it is vital to quantify uncertainty due to rounding along other sources like measurement, sampling, and numerical discretization. Traditional deterministic rounding uncertainty analysis (DBEA) assumes that the rounding errors equal the unit roundoff $u$. However, despite providing strong guarantees, DBEA severely overestimates rounding uncertainty. This work presents a novel probabilistic rounding uncertainty analysis called VIBEA. By treating rounding errors as i.i.d. random variables and leveraging concentration inequalities, VIBEA provides high-confidence estimates for rounding uncertainty using higher-order rounding error statistics. The presented framework is valid for all problem sizes $n$, unlike DBEA, which necessitates $nu<1$. Further, it can account for the potential cancellation of rounding errors, resulting in rounding uncertainty estimates that grow slowly with $n$. We show that for $n>n_c(u)$, VIBEA produces tighter estimates for rounding uncertainty than DBEA. We also show that VIBEA improves existing probabilistic rounding uncertainty analysis techniques for $n\ge3$ by using higher-order rounding error statistics. We conduct numerical experiments on random vector dot products, a linear system solution, and a stochastic boundary value problem. We show that quantifying rounding uncertainty along with traditional sources (numerical discretization, sampling, parameters) enables a more efficient allocation of computational resources, thereby balancing computational efficiency with predictive accuracy. This study is a step towards a comprehensive mixed-precision approach that improves model reliability and enables budgeting of computational resources in predictive modeling and decision-making.

Evaluation of Rounding Functions in Nearest-Neighbor Interpolation

Nearest Neighbor Value Interpolation

Benefit of Interpolation in Nearest Neighbor Algorithms

Study on Roundness Error Evaluation with Least-Squares Method Based on Nonlinear Optimization

Effects of Improved Floor Function on the Accuracy of Bilinear Interpolation Algorithm

A unified weighting framework for evaluating nearest neighbour classification

Normalized Weighting Schemes for Image Interpolation Algorithms

Quantum realization of the nearest neighbor value interpolation method for INEQR

Exploring the impact of post-training rounding in regression models

What You Will Gain By Rounding: Theory and Algorithms for Rounding Rank

In defense of Nearest-Neighbor based image classification

Performance Evaluation of Edge-Directed Interpolation Methods for Images

A Novel Method for Uncertainty Evaluation of Roundness Errors Based on Geometrical Product Specification

Variance-informed Rounding Uncertainty Analysis for Floating-point Statistical Models

Inexactness and Correction of Floating-Point Reciprocal, Division and Square Root

Rounding Methods for Neural Networks with Low Resolution Synaptic Weights

Derived Codebooks for High-Accuracy Nearest Neighbor Search

A Multi-Precision Quadratic Regularization Method for Unconstrained Optimization with Rounding Error Analysis

A Theory-Based Evaluation of Nearest Neighbor Models Put Into Practice

Theoretical Analysis of the Confidence Metrics for Nearest Neighbor Classifier

Technical Report on Visual Quality Assessment for Frame Interpolation