Abstract:A major barrier to applying deep segmentation models in the medical domain is their typical data-hungry nature, requiring experts to collect and label large amounts of data for training. As a reaction, prototypical few-shot segmentation (FSS) models have recently gained traction as data-efficient alternatives. Nevertheless, despite the recent progress of these models, they still have some essential shortcomings that must be addressed. In this work, we focus on three of these shortcomings: (i) the lack of uncertainty estimation, (ii) the lack of a guiding mechanism to help locate edges and encourage spatial consistency in the segmentation maps, and (iii) the models' inability to do one-step multi-class segmentation. Without modifying or requiring a specific backbone architecture, we propose a modified prototype extraction module that facilitates the computation of uncertainty maps in prototypical FSS models, and show that the resulting maps are useful indicators of the model uncertainty. To improve the segmentation around boundaries and to encourage spatial consistency, we propose a novel feature refinement module that leverages structural information in the input space to help guide the segmentation in the feature space. Furthermore, we demonstrate how uncertainty maps can be used to automatically guide this feature refinement. Finally, to avoid ambiguous voxel predictions that occur when images are segmented class-by-class, we propose a procedure to perform one-step multi-class FSS. The efficiency of our proposed methodology is evaluated on two representative datasets for abdominal organ segmentation (CHAOS dataset and BTCV dataset) and one dataset for cardiac segmentation (MS-CMRSeg dataset). The results show that our proposed methodology significantly (one-sided Wilcoxon signed rank test, p<0.05) improves the baseline, increasing the overall dice score with +5.2, +5.1, and +2.8 percentage points for the CHAOS dataset, the BTCV dataset, and the MS-CMRSeg dataset, respectively.

One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentation

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

A Lightweight Deep Network for 3D Medical Image Segmentation.

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

Accelerating 3D Medical Image Segmentation by Adaptive Small-Scale Target Localization

Deep Sequential Segmentation of Organs in Volumetric Medical Scans

ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement

TMD-Unet: Triple-Unet with Multi-Scale Input Features and Dense Skip Connection for Medical Image Segmentation

3D EdgeSegNET: a deep neural network framework for simultaneous edge detection and segmentation of medical images

OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentation

3D ConvNet+: A lightweight adaptive network for 3D medical image segmentation

A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation

Automatic 3D Medical Image Segmentation with Densely-Connected Volumetric ConvNets

AtlasNet: Multi-atlas Non-linear Deep Networks for Medical Image Segmentation

AutoML Segmentation for 3D Medical Image Data: Contribution to the MSD Challenge 2018

IP-UNet: Intensity Projection UNet Architecture for 3D Medical Volume Segmentation

ERDUnet: An Efficient Residual Double-coding Unet for Medical Image Segmentation

W-Net: Dual Supervised Medical Image Segmentation Model with Multi-Dimensional Attention and Cascade Multi-Scale Convolution

DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation