Abstract:Image-based environment perception is an important component especially for driver assistance systems or autonomous driving. In this scope, modern neuronal networks are used to identify multiple objects as well as the according position and size information within a single frame. The performance of such an object detection model is important for the overall performance of the whole system. However, a detection model might also predict these objects under a certain degree of uncertainty. [...] In this work, we examine the semantic uncertainty (which object type?) as well as the spatial uncertainty (where is the object and how large is it?). We evaluate if the predicted uncertainties of an object detection model match with the observed error that is achieved on real-world data. In the first part of this work, we introduce the definition for confidence calibration of the semantic uncertainty in the context of object detection, instance segmentation, and semantic segmentation. We integrate additional position information in our examinations to evaluate the effect of the object's position on the semantic calibration properties. Besides measuring calibration, it is also possible to perform a post-hoc recalibration of semantic uncertainty that might have turned out to be miscalibrated. [...] The second part of this work deals with the spatial uncertainty obtained by a probabilistic detection model. [...] We review and extend common calibration methods so that it is possible to obtain parametric uncertainty distributions for the position information in a more flexible way. In the last part, we demonstrate a possible use-case for our derived calibration methods in the context of object tracking. [...] We integrate our previously proposed calibration techniques and demonstrate the usefulness of semantic and spatial uncertainty calibration in a subsequent process. [...]

CertainNet: Sampling-free Uncertainty Estimation for Object Detection

EvCenterNet: Uncertainty Estimation for Object Detection using Evidential Learning

Lightweight Model Uncertainty Estimation for Deep Neural Object Detection

Uncertainty Calibration and its Application to Object Detection

BayesNetCNN: incorporating uncertainty in neural networks for image-based classification tasks

Uncertainty-Aware AB3DMOT by Variational 3D Object Detection

Uncertainty Estimation for 3D Object Detection via Evidential Learning

An Uncertainty Estimation Framework for Probabilistic Object Detection

Uncertainty-Aware Self-Improving Framework for Depth Estimation

UDNet: Uncertainty-aware Deep Network for Salient Object Detection

Uncertainty estimation in Deep Learning for Panoptic segmentation

GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimation

Efficient Bayesian Uncertainty Estimation for nnU-Net

A Theoretical and Practical Framework for Evaluating Uncertainty Calibration in Object Detection

Feature Decoupling and Uncertainty Estimation for 3D Object Detection

Estimating Uncertainty in Neural Networks for Cardiac MRI Segmentation: A Benchmark Study

Efficient Uncertainty Estimation for Monocular 3D Object Detection in Autonomous Driving

Cost-Sensitive Uncertainty-Based Failure Recognition for Object Detection

Uncertainty Aware Proposal Segmentation for Unknown Object Detection

Masked Gamma-SSL: Learning Uncertainty Estimation via Masked Image Modeling

Uncertainty-Aware Depth Network for Visual Inertial Odometry of Mobile Robots