Abstract:Advancements in computer hardware have made it possible to utilize low- and mixed-precision arithmetic for enhanced computational efficiency. In practical predictive modeling, however, it is vital to quantify uncertainty due to rounding along other sources like measurement, sampling, and numerical discretization. Traditional deterministic rounding uncertainty analysis (DBEA) assumes that the rounding errors equal the unit roundoff $u$. However, despite providing strong guarantees, DBEA severely overestimates rounding uncertainty. This work presents a novel probabilistic rounding uncertainty analysis called VIBEA. By treating rounding errors as i.i.d. random variables and leveraging concentration inequalities, VIBEA provides high-confidence estimates for rounding uncertainty using higher-order rounding error statistics. The presented framework is valid for all problem sizes $n$, unlike DBEA, which necessitates $nu<1$. Further, it can account for the potential cancellation of rounding errors, resulting in rounding uncertainty estimates that grow slowly with $n$. We show that for $n>n_c(u)$, VIBEA produces tighter estimates for rounding uncertainty than DBEA. We also show that VIBEA improves existing probabilistic rounding uncertainty analysis techniques for $n\ge3$ by using higher-order rounding error statistics. We conduct numerical experiments on random vector dot products, a linear system solution, and a stochastic boundary value problem. We show that quantifying rounding uncertainty along with traditional sources (numerical discretization, sampling, parameters) enables a more efficient allocation of computational resources, thereby balancing computational efficiency with predictive accuracy. This study is a step towards a comprehensive mixed-precision approach that improves model reliability and enables budgeting of computational resources in predictive modeling and decision-making.

Evaluating uncertainty with Vertical Barrier Models

Variational inference: uncertainty quantification in additive models

Large-sample theory for inferential models: a possibilistic Bernstein--von Mises theorem

Variational Bayesian Inference and Complexity Control for Stochastic Block Models

Variance-informed Rounding Uncertainty Analysis for Floating-point Statistical Models

Meta-Uncertainty in Bayesian Model Comparison

A general model validation and testing tool

Uncertainty Quantification for Markov Processes via Variational Principles and Functional Inequalities

New Bayesian method for estimation of Value at Risk and Conditional Value at Risk

Uncertainty-Aware Evaluation for Vision-Language Models

Covariances, Robustness, and Variational Bayes

Generalization Bounds for Vicinal Risk Minimization Principle

Bayesian Analysis of Value-at-Risk with Product Partition Models

Bi-fidelity Variational Auto-encoder for Uncertainty Quantification

Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation

Bayesian Model Selection via Mean-Field Variational Approximation

Validated Variational Inference via Practical Posterior Error Bounds

A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

Risk Measures Estimation Under Wasserstein Barycenter

Uncertainty Estimates of Predictions via a General Bias-Variance Decomposition

On Uncertainty Quantification for Near-Bayes Optimal Algorithms