Abstract:<p>Most image segmentation algorithms are trained on binary masks formulated as a classification task per pixel. However, in applications such as medical imaging, this "black-and-white" approach is too constraining because the contrast between two tissues is often ill-defined, i.e., the voxels located on objects' edges contain a mixture of tissues (a partial volume effect). Consequently, assigning a single "hard" label can result in a detrimental approximation. Instead, a soft prediction containing non-binary values would overcome that limitation. In this study, we introduce SoftSeg, a deep learning training approach that takes advantage of soft ground truth labels, and is not bound to binary predictions. SoftSeg aims at solving a regression instead of a classification problem. This is achieved by using (i) no binarization after preprocessing and data augmentation, (ii) a normalized ReLU final activation layer (instead of sigmoid), and (iii) a regression loss function (instead of the traditional Dice loss). We assess the impact of these three features on three open-source MRI segmentation datasets from the spinal cord gray matter, the multiple sclerosis brain lesion, and the multimodal brain tumor segmentation challenges. Across multiple cross-validation iterations, SoftSeg outperformed the conventional approach, leading to an increase in Dice score of 2.0% on the gray matter dataset (p=0.001), 3.3% for the brain lesions, and 6.5% for the brain tumors. SoftSeg produces consistent soft predictions at a tissues' interfaces and shows an increased sensitivity for small objects (e.g., multiple sclerosis lesions). The richness of soft labels could represent the inter-expert variability, the partial volume effect, and complement the model uncertainty estimation, which is typically unclear with binary predictions. The developed training pipeline can easily be incorporated into most of the existing deep learning architectures. It is already implemented in the freely-available deep learning toolbox ivadomed (<a href="https://ivadomed.org">https://ivadomed.org</a>).</p>

Soft labelling for semantic segmentation: Bringing coherence to label down-sampling

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentation

Semantic Segmentation Using Pixel-Wise Adaptive Label Smoothing via Self-Knowledge Distillation for Limited Labeling Data

Learning to Downsample for Segmentation of Ultra-High Resolution Images

Simple Does It: Weakly Supervised Instance and Semantic Segmentation

High-fidelity Pseudo-labels for Boosting Weakly-Supervised Segmentation

Local structure consistency and pixel-correlation distillation for compact semantic segmentation

SlimSeg: Slimmable Semantic Segmentation with Boundary Supervision

Double Similarity Distillation for Semantic Image Segmentation

SoftSeg: Advantages of soft versus binary training for image segmentation

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation

Superpixel Consistency Saliency Map Generation for Weakly Supervised Semantic Segmentation of Remote Sensing Images

Learning from Weak and Noisy Labels for Semantic Segmentation.

A Simple Baseline for Semi-supervised Semantic Segmentation with Strong Data Augmentation

Roll With the Punches: Expansion and Shrinkage of Soft Label Selection for Semi-supervised Fine-Grained Learning

Label Smarter, Not Harder: CleverLabel for Faster Annotation of Ambiguous Image Classification with Higher Quality

Modeling the Label Distributions for Weakly-Supervised Semantic Segmentation

Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation

CALSeg: Improving Calibration of Medical Image Segmentation Via Variational Label Smoothing