Abstract:Segmentation tasks in medical imaging are inherently ambiguous: the boundary of a target structure is oftentimes unclear due to image quality and biological factors. As such, predicted segmentations from deep learning algorithms are inherently ambiguous. Additionally, "ground truth" segmentations performed by human annotators are in fact weak labels that further increase the uncertainty of outputs of supervised models developed on these manual labels. To date, most deep learning segmentation studies utilize predicted segmentations without uncertainty quantification. In contrast, we explore the use of Monte Carlo dropout U-Nets for the segmentation with additional quantification of segmentation uncertainty. We assess the utility of three measures of uncertainty (Coefficient of Variation, Mean Pairwise Dice, and Mean Voxelwise Uncertainty) for the segmentation of a less ambiguous target structure (liver) and a more ambiguous one (liver tumors). Furthermore, we assess how the utility of these measures changes with different patch sizes and cost functions. Our results suggest that models trained using larger patches and the weighted categorical cross-entropy as cost function allow the extraction of more meaningful uncertainty measures compared to smaller patches and soft dice loss. Among the three uncertainty measures Mean Pairwise Dice shows the strongest correlation with segmentation quality. Our study serves as a proof-of-concept of how uncertainty measures can be used to assess the quality of a predicted segmentation, potentially serving to flag low quality segmentations from a given model for further human review.

Evaluation of Multi-task Uncertainties in Joint Semantic Segmentation and Monocular Depth Estimation

Efficient Multi-task Uncertainties for Joint Semantic Segmentation and Monocular Depth Estimation

Uncertainty estimation in Deep Learning for Panoptic segmentation

DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentation

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics

Bayesian Deep Neural Networks for Supervised Learning of Single-View Depth

Multi-Loss Sub-Ensembles for Accurate Classification with Uncertainty Estimation

Boosting Unsupervised Monocular Depth Estimation with Auxiliary Semantic Information

Semantic Segmentation and Depth Estimation of Urban Road Scene Images Using Multi-Task Networks

Self-Supervised Monocular Depth Estimation by Digging into Uncertainty Quantification

To Complete or to Estimate, That is the Question: A Multi-Task Approach to Depth Completion and Monocular Depth Estimation

Uncertainty Guided Self-Supervised Monocular Depth Estimation Based on Monte Carlo Method

Self-supervised Monocular Depth Estimation with Uncertainty-aware Feature Enhancement and Depth Fusion

Joint-Confidence-Guided Multi-Task Learning for 3D Reconstruction and Understanding from Monocular Camera

Calibrating Ensembles for Scalable Uncertainty Quantification in Deep Learning-based Medical Segmentation

Real-Time Evaluation of Perception Uncertainty and Validity Verification of Autonomous Driving

MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty

Give me (un)certainty -- An exploration of parameters that affect segmentation uncertainty

Quantification of Uncertainties in Deep Learning-based Environment Perception

Deep Deterministic Uncertainty for Semantic Segmentation