Lightweight Uncertainty Quantification with Simplex Semantic Segmentation for Terrain Traversability

Judith Dijk,Gertjan Burghouts,Kapil D. Katyal,Bryanna Y. Yeh,Craig T. Knuth,Ella Fokkinga,Tejaswi Kasarla,Pascal Mettes
2024-07-18
Abstract:For navigation of robots, image segmentation is an important component to determining a terrain's traversability. For safe and efficient navigation, it is key to assess the uncertainty of the predicted segments. Current uncertainty estimation methods are limited to a specific choice of model architecture, are costly in terms of training time, require large memory for inference (ensembles), or involve complex model architectures (energy-based, hyperbolic, masking). In this paper, we propose a simple, light-weight module that can be connected to any pretrained image segmentation model, regardless of its architecture, with marginal additional computation cost because it reuses the model's backbone. Our module is based on maximum separation of the segmentation classes by respective prototype vectors. This optimizes the probability that out-of-distribution segments are projected in between the prototype vectors. The uncertainty value in the classification label is obtained from the distance to the nearest prototype. We demonstrate the effectiveness of our module for terrain segmentation.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper aims to address the issue of uncertainty quantification in image segmentation for off-road robot navigation. Specifically, the authors propose a lightweight module that can be attached to any pre-trained image segmentation model to assess the uncertainty of segmentation results. Current uncertainty estimation methods have some limitations, such as requiring specific model architectures, long training times, high memory usage during inference (e.g., ensemble methods), or complex model architectures (e.g., energy-based methods, hyperbolic space methods, mask methods). To address these issues, the authors propose a simple and computationally efficient method based on maximizing the separation between segmentation classes using prototype vectors. The module obtains the uncertainty value of classification labels by measuring the distance between pixel features and the nearest prototype vector. This method is not only suitable for segmentation tasks with known classes but also effectively detects out-of-distribution data. Experimental results show that this method outperforms existing standard methods on multiple datasets and has advantages in terms of computational cost. Additionally, the method exhibits higher uncertainty in edge regions, which helps robots adopt safer strategies in uncertain areas.