Abstract:Uncertainty quantification and robustness to distribution shifts are important goals in machine learning and artificial intelligence. Although Bayesian Neural Networks (BNNs) allow for uncertainty in the predictions to be assessed, different sources of predictive uncertainty cannot be distinguished properly. We present Credal Bayesian Deep Learning (CBDL). Heuristically, CBDL allows to train an (uncountably) infinite ensemble of BNNs, using only finitely many elements. This is possible thanks to prior and likelihood finitely generated credal sets (FGCSs), a concept from the imprecise probability literature. Intuitively, convex combinations of a finite collection of prior-likelihood pairs are able to represent infinitely many such pairs. After training, CBDL outputs a set of posteriors on the parameters of the neural network. At inference time, such posterior set is used to derive a set of predictive distributions that is in turn utilized to distinguish between (predictive) aleatoric and epistemic uncertainties, and to quantify them. The predictive set also produces either (i) a collection of outputs enjoying desirable probabilistic guarantees, or (ii) the single output that is deemed the best, that is, the one having the highest predictive lower probability -- another imprecise-probabilistic concept. CBDL is more robust than single BNNs to prior and likelihood misspecification, and to distribution shift. We show that CBDL is better at quantifying and disentangling different types of (predictive) uncertainties than single BNNs and ensemble of BNNs. In addition, we apply CBDL to two case studies to demonstrate its downstream tasks capabilities: one, for motion prediction in autonomous driving scenarios, and two, to model blood glucose and insulin dynamics for artificial pancreas control. We show that CBDL performs better when compared to an ensemble of BNNs baseline.

Uncertainty in Bayesian deep label distribution learning

Uncertainty-Aware Learning against Label Noise on Imbalanced Datasets

A Bayesian Deep Learning RUL Framework Integrating Epistemic and Aleatoric Uncertainties

Label-Confidence-Aware Uncertainty Estimation in Natural Language Generation

What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?

Quantifying Uncertainty in Discrete-Continuous and Skewed Data with Bayesian Deep Learning

Deep Label Distribution Learning with Label Ambiguity

A Bayesian Deep Learning Framework for RUL Prediction Incorporating Uncertainty Quantification and Calibration

Improving Medical Images Classification with Label Noise Using Dual-Uncertainty Estimation

Credal Bayesian Deep Learning

Understanding Uncertainty in Bayesian Deep Learning

On Modelling Label Uncertainty in Deep Neural Networks: Automatic Estimation of Intra-observer Variability in 2D Echocardiography Quality Assessment

Modeling the Uncertainty in Electronic Health Records: a Bayesian Deep Learning Approach

Label Distribution Learning using the Squared Neural Family on the Probability Simplex

Label Distribution Learning: A Local Collaborative Mechanism

Deep Bayesian Active Learning, A Brief Survey on Recent Advances

The Epistemic Uncertainty Hole: an issue of Bayesian Neural Networks

Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say "I don't know" for Ambiguous Cases

BSM loss: A superior way in modeling aleatory uncertainty of fine_grained classification

Inaccurate Label Distribution Learning

BUNDL: Bayesian Uncertainty-aware Deep Learning with Noisy training Labels for Seizure Detection in EEG