Abstract:Uncertainty quantification and robustness to distribution shifts are important goals in machine learning and artificial intelligence. Although Bayesian Neural Networks (BNNs) allow for uncertainty in the predictions to be assessed, different sources of predictive uncertainty cannot be distinguished properly. We present Credal Bayesian Deep Learning (CBDL). Heuristically, CBDL allows to train an (uncountably) infinite ensemble of BNNs, using only finitely many elements. This is possible thanks to prior and likelihood finitely generated credal sets (FGCSs), a concept from the imprecise probability literature. Intuitively, convex combinations of a finite collection of prior-likelihood pairs are able to represent infinitely many such pairs. After training, CBDL outputs a set of posteriors on the parameters of the neural network. At inference time, such posterior set is used to derive a set of predictive distributions that is in turn utilized to distinguish between (predictive) aleatoric and epistemic uncertainties, and to quantify them. The predictive set also produces either (i) a collection of outputs enjoying desirable probabilistic guarantees, or (ii) the single output that is deemed the best, that is, the one having the highest predictive lower probability -- another imprecise-probabilistic concept. CBDL is more robust than single BNNs to prior and likelihood misspecification, and to distribution shift. We show that CBDL is better at quantifying and disentangling different types of (predictive) uncertainties than single BNNs and ensemble of BNNs. In addition, we apply CBDL to two case studies to demonstrate its downstream tasks capabilities: one, for motion prediction in autonomous driving scenarios, and two, to model blood glucose and insulin dynamics for artificial pancreas control. We show that CBDL performs better when compared to an ensemble of BNNs baseline.

On Exact Bayesian Credible Sets for Classification and Pattern Recognition

Approximate Bayesian Computation via Classification

Ensemble-based Uncertainty Quantification: Bayesian versus Credal Inference

Conformalized Credal Regions for Classification with Ambiguous Ground Truth

Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix

Probabilistic Safety Regions Via Finite Families of Scalable Classifiers

ABC-CDE: Towards Approximate Bayesian Computation with Complex High-Dimensional Data and Limited Simulations

Bayesian-Estimation Methods for Categorical-Data with Misclassifications

A rare event approach to high dimensional Approximate Bayesian computation

Credal Bayesian Deep Learning

Conformalized Credal Set Predictors

Updating information based on generalized credal sets. Part 1: Finite case

Robust Bayesian Classification with Incomplete Data

Assessing Credibility in Bayesian Networks Structure Learning

Likelihood Ratio Confidence Sets for Sequential Decision Making

A Na&#x00ef;ve Bayesian Classifier in Categorical Uncertain Data Streams

Robust Classification Using Posterior Probability Threshold Computation Followed by Voronoi Cell Based Class Assignment Circumventing Pitfalls of Bayesian Analysis of Biomedical Data

Monte Carlo Confidence Sets for Identified Sets

Trust but Verify: Assigning Prediction Credibility by Counterfactual Constrained Learning

Credal Two-Sample Tests of Epistemic Ignorance

Credal Wrapper of Model Averaging for Uncertainty Estimation on Out-Of-Distribution Detection