Abstract:Image structures are segmented automatically using deep learning (DL) for analysis and processing. The three most popular base loss functions are cross entropy (crossE), intersect-over-the-union (IoU), and dice. Which should be used, is it useful to consider simple variations, such as modifying formula coefficients? How do characteristics of different image structures influence scores? Taking three different medical image segmentation problems (segmentation of organs in magnetic resonance images (MRI), liver in computer tomography images (CT) and diabetic retinopathy lesions in eye fundus images (EFI)), we quantify loss functions and variations, as well as segmentation scores of different targets. We first describe the limitations of metrics, since loss is a metric, then we describe and test alternatives. Experimentally, we observed that DeeplabV3 outperforms UNet and fully convolutional network (FCN) in all datasets. Dice scored 1 to 6 percentage points (pp) higher than cross entropy over all datasets, IoU improved 0 to 3 pp. Varying formula coefficients improved scores, but the best choices depend on the dataset: compared to crossE, different false positive vs. false negative weights improved MRI by 12 pp, and assigning zero weight to background improved EFI by 6 pp. Multiclass segmentation scored higher than n-uniclass segmentation in MRI by 8 pp. EFI lesions score low compared to more constant structures (e.g., optic disk or even organs), but loss modifications improve those scores significantly 6 to 9 pp. Our conclusions are that dice is best, it is worth assigning 0 weight to class background and to test different weights on false positives and false negatives.

Segmentation Loss Odyssey

Loss odyssey in medical image segmentation

SemSegLoss: A python package of loss functions for semantic segmentation

Adaptive Region-Specific Loss for Improved Medical Image Segmentation

Dual-Term Loss Function for Shape-Aware Medical Image Segmentation.

Boundary-wise Loss for Medical Image Segmentation Based on Fuzzy Rough Sets

Offset Curves Loss for Imbalanced Problem in Medical Segmentation

Contour-weighted loss for class-imbalanced image segmentation

Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation

Testing Segmentation Popular Loss and Variations in Three Multiclass Medical Imaging Problems

Random Drop Loss For Tiny Object Segmentation: Application To Lesion Segmentation In Fundus Images

A Generalized Surface Loss for Reducing the Hausdorff Distance in Medical Imaging Segmentation

High-Resolution Boundary Detection for Medical Image Segmentation with Piece-Wise Two-Sample T-Test Augmented Loss

Shape Description Losses for Medical Image Segmentation

High-level Prior-based Loss Functions for Medical Image Segmentation: A Survey

Δard Loss for Low-Contrast Medical Image Segmentation

Boundary Difference Over Union Loss For Medical Image Segmentation

Structure-aware Loss Function for Ultrasound Image Segmentation

An Analysis of Loss Functions for Heavily Imbalanced Lesion Segmentation

GapLoss: A Loss Function for Semantic Segmentation of Roads in Remote Sensing Images.

Residual Moment Loss for Medical Image Segmentation