Abstract:Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anomalous data, or emitting warnings when an error is likely to be inbound. This is particularly crucial in safety-critical areas like medical image classification or self-driving cars. Despite the plethora of proposed uncertainty quantification methods achieving increasingly higher scores on performance benchmarks, uncertainty estimates are often shied away from in practice. Many machine learning projects start from pretrained latent representations that come without uncertainty estimates. Uncertainties would need to be trained by practitioners on their own, which is notoriously difficult and resource-intense. This thesis makes uncertainty estimates easily accessible by adding them to the latent representation vectors of pretrained computer vision models. Besides proposing approaches rooted in probability and decision theory, such as Monte-Carlo InfoNCE (MCInfoNCE) and loss prediction, we delve into both theoretical and empirical questions. We show that these unobservable uncertainties about unobservable latent representations are indeed provably correct. We also provide an uncertainty-aware representation learning (URL) benchmark to compare these unobservables against observable ground-truths. Finally, we compile our findings to pretrain lightweight representation uncertainties on large-scale computer vision models that transfer to unseen datasets in a zero-shot manner. Our findings do not only advance the current theoretical understanding of uncertainties over latent variables, but also facilitate the access to uncertainty quantification for future researchers inside and outside the field, enabling straightforward but trustworthy machine learning.

What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?

Understanding Uncertainty in Bayesian Deep Learning

Uncertainty in Real-Time Semantic Segmentation on Embedded Systems

A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation

Uncertainty in Bayesian deep label distribution learning

Uncertainty estimation in Deep Learning for Panoptic segmentation

Uncertainties of Latent Representations in Computer Vision

The Epistemic Uncertainty Hole: an issue of Bayesian Neural Networks

Deep Modeling of Non-Gaussian Aleatoric Uncertainty

Bayesian Deep Neural Networks for Supervised Learning of Single-View Depth

Uncertainty in latent representations of variational autoencoders optimized for visual tasks

Looking at the posterior: accuracy and uncertainty of neural-network predictions

Single-Model Uncertainties for Deep Learning

From Registration Uncertainty to Segmentation Uncertainty

Uncertainty Quantification for Deep Learning

Probabilistic Deep Learning for Instance Segmentation

Efficient Multi-task Uncertainties for Joint Semantic Segmentation and Monocular Depth Estimation

Epistemic Uncertainty-Weighted Loss for Visual Bias Mitigation

Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications

Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say "I don't know" for Ambiguous Cases

Multidimensional Uncertainty Quantification for Deep Neural Networks