Effect of tromethamine (THAM) on infarct volume following permanent middle cerebral artery occlusion in rats.

K. Kiening,G. Schneider,A. Unterberg,W. Lanksch

DOI: https://doi.org/10.1007/978-3-7091-6837-0_58

Abstract:

What problem does this paper attempt to address?

Optimization for Medical Image Segmentation: Theory and Practice when evaluating with Dice Score or Jaccard Index

Tom Eelbode,Jeroen Bertels,Maxim Berman,Dirk Vandermeulen,Frederik Maes,Raf Bisschops,Matthew B. Blaschko

DOI: https://doi.org/10.1109/TMI.2020.3002417

2020-10-26

Abstract:In many medical imaging and classical computer vision tasks, the Dice score and Jaccard index are used to evaluate the segmentation performance. Despite the existence and great empirical success of metric-sensitive losses, i.e. relaxations of these metrics such as soft Dice, soft Jaccard and Lovasz-Softmax, many researchers still use per-pixel losses, such as (weighted) cross-entropy to train CNNs for segmentation. Therefore, the target metric is in many cases not directly optimized. We investigate from a theoretical perspective, the relation within the group of metric-sensitive loss functions and question the existence of an optimal weighting scheme for weighted cross-entropy to optimize the Dice score and Jaccard index at test time. We find that the Dice score and Jaccard index approximate each other relatively and absolutely, but we find no such approximation for a weighted Hamming similarity. For the Tversky loss, the approximation gets monotonically worse when deviating from the trivial weight setting where soft Tversky equals soft Dice. We verify these results empirically in an extensive validation on six medical segmentation tasks and can confirm that metric-sensitive losses are superior to cross-entropy based loss functions in case of evaluation with Dice Score or Jaccard Index. This further holds in a multi-class setting, and across different object sizes and foreground/background ratios. These results encourage a wider adoption of metric-sensitive loss functions for medical segmentation tasks where the performance measure of interest is the Dice score or Jaccard index.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice

Jeroen Bertels,Tom Eelbode,Maxim Berman,Dirk Vandermeulen,Frederik Maes,Raf Bisschops,Matthew Blaschko

DOI: https://doi.org/10.1007/978-3-030-32245-8_11

2019-11-05

Abstract:The Dice score and Jaccard index are commonly used metrics for the evaluation of segmentation tasks in medical imaging. Convolutional neural networks trained for image segmentation tasks are usually optimized for (weighted) cross-entropy. This introduces an adverse discrepancy between the learning optimization objective (the loss) and the end target metric. Recent works in computer vision have proposed soft surrogates to alleviate this discrepancy and directly optimize the desired metric, either through relaxations (soft-Dice, soft-Jaccard) or submodular optimization (Lovász-softmax). The aim of this study is two-fold. First, we investigate the theoretical differences in a risk minimization framework and question the existence of a weighted cross-entropy loss with weights theoretically optimized to surrogate Dice or Jaccard. Second, we empirically investigate the behavior of the aforementioned loss functions w.r.t. evaluation with Dice score and Jaccard index on five medical segmentation tasks. Through the application of relative approximation bounds, we show that all surrogates are equivalent up to a multiplicative factor, and that no optimal weighting of cross-entropy exists to approximate Dice or Jaccard measures. We validate these findings empirically and show that, while it is important to opt for one of the target metric surrogates rather than a cross-entropy-based loss, the choice of the surrogate does not make a statistical difference on a wide range of medical segmentation tasks.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing
Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation

Michael Yeung,Evis Sala,Carola-Bibiane Schönlieb,Leonardo Rundo

DOI: https://doi.org/10.1016/j.compmedimag.2021.102026

IF: 7.422

2022-01-01

Computerized Medical Imaging and Graphics

Abstract:Automatic segmentation methods are an important advancement in medical image analysis. Machine learning techniques, and deep neural networks in particular, are the state-of-the-art for most medical image segmentation tasks. Issues with class imbalance pose a significant challenge in medical datasets, with lesions often occupying a considerably smaller volume relative to the background. Loss functions used in the training of deep learning algorithms differ in their robustness to class imbalance, with direct consequences for model convergence. The most commonly used loss functions for segmentation are based on either the cross entropy loss, Dice loss or a combination of the two. We propose the Unified Focal loss, a new hierarchical framework that generalises Dice and cross entropy-based losses for handling class imbalance. We evaluate our proposed loss function on five publicly available, class imbalanced medical imaging datasets: CVC-ClinicDB, Digital Retinal Images for Vessel Extraction (DRIVE), Breast Ultrasound 2017 (BUS2017), Brain Tumour Segmentation 2020 (BraTS20) and Kidney Tumour Segmentation 2019 (KiTS19). We compare our loss function performance against six Dice or cross entropy-based loss functions, across 2D binary, 3D binary and 3D multiclass segmentation tasks, demonstrating that our proposed loss function is robust to class imbalance and consistently outperforms the other loss functions. Source code is available at: https://github.com/mlyg/unified-focal-loss.

engineering, biomedical,radiology, nuclear medicine & medical imaging
A Generalized Surface Loss for Reducing the Hausdorff Distance in Medical Imaging Segmentation

Adrian Celaya,Beatrice Riviere,David Fuentes

2024-01-24

Abstract:Within medical imaging segmentation, the Dice coefficient and Hausdorff-based metrics are standard measures of success for deep learning models. However, modern loss functions for medical image segmentation often only consider the Dice coefficient or similar region-based metrics during training. As a result, segmentation architectures trained over such loss functions run the risk of achieving high accuracy for the Dice coefficient but low accuracy for Hausdorff-based metrics. Low accuracy on Hausdorff-based metrics can be problematic for applications such as tumor segmentation, where such benchmarks are crucial. For example, high Dice scores accompanied by significant Hausdorff errors could indicate that the predictions fail to detect small tumors. We propose the Generalized Surface Loss function, a novel loss function to minimize Hausdorff-based metrics with more desirable numerical properties than current methods and with weighting terms for class imbalance. Our loss function outperforms other losses when tested on the LiTS and BraTS datasets using the state-of-the-art nnUNet architecture. These results suggest we can improve medical imaging segmentation accuracy with our novel loss function.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Loss odyssey in medical image segmentation

Jun Ma,Jianan Chen,Matthew Ng,Rui Huang,Yu Li,Chen Li,Xiaoping Yang,Anne L Martel,Anne L. Martel

DOI: https://doi.org/10.1016/j.media.2021.102035

IF: 10.9

2021-07-01

Medical Image Analysis

Abstract:<p>The loss function is an important component in deep learning-based segmentation methods. Over the past five years, many loss functions have been proposed for various segmentation tasks. However, a systematic study of the utility of these loss functions is missing. In this paper, we present a comprehensive review of segmentation loss functions in an organized manner. We also conduct the first large-scale analysis of 20 general loss functions on four typical 3D segmentation tasks involving six public datasets from 10+ medical centers. The results show that none of the losses can consistently achieve the best performance on the four segmentation tasks, but compound loss functions (e.g. Dice with TopK loss, focal loss, Hausdorff distance loss, and boundary loss) are the most robust losses. Our code and segmentation results are publicly available and can serve as a loss function benchmark. We hope this work will also provide insights on new loss function development for the community.</p>

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Advancing precision in medical image segmentation: A performance analysis of loss functions for COVID‐19 lung infection segmentation in computed tomography images

Emilio Delgado,Roberto Rodriguez‐Echeverria,Antonio Jesús Fernández‐García,Juan D. Gutiérrez,Miguel Ángel Suero‐Rodrigo

DOI: https://doi.org/10.1049/ipr2.13232

IF: 2.3

2024-09-27

IET Image Processing

Abstract:1. Selection and evaluation of loss functions: An extensive evaluation of different loss functions, including asymmetric unified focal loss, dice similarity coefficient loss, and cross entropy, is conducted to address challenges in segmenting lung infections caused by COVID‐19 in computed tomography images. 2. Comparative performance analysis: This study compared these loss functions using different deep learning architectures, highlighting their impact on segmentation accuracy. 3. Illustrative examples of segmentation performance: Examples demonstrating the effectiveness of these loss functions in identifying and delineating lung lesions are presented. This study evaluates the effectiveness of three loss functions Asymmetric Unified Focal Loss (AUFL), Dice Similarity Coefficient Loss (DSCL), and Cross‐Entropy (CE) for segmenting COVID‐19 lung infections in computed tomography images. Detailed analyses using the intersection over union metric assessed each function's accuracy. AUFL achieved an average Dice Similarity Coefficient (DSC) of 85.18% ± 8.86%, outperforming DSCL 85.18% ± 8.86%, which had the same average DSC but less precise segmentation, and CE, which had an average DSC of 78.31% ± 11.93%. Segmentations using AUFL demonstrated more defined contours and better alignment with actual anatomical structures than those obtained with DSCL and CE. Observations revealed that AUFL‐generated segmentations had more precise boundaries and were more consistent with the expected anatomical regions of lung infections. This study is the first to quantitatively and qualitatively compare the effectiveness of AUFL, DSCL, and CE in segmenting COVID‐19 lung infections, providing concrete evidence of AUFL's superiority in segmentation performance and reliability for clinical applications. The findings underscore the importance of selecting appropriate loss functions to enhance segmentation in medical imaging, highlighting their crucial role in improving image‐based diagnostics and treatment. The study emphasizes the need for ongoing research to optimize these segmentation techniques further.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations

Carole H. Sudre,Wenqi Li,Tom Vercauteren,Sebastien Ourselin,M. Jorge Cardoso

DOI: https://doi.org/10.1007/978-3-319-67558-9_28

2017-01-01

Abstract:Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but also on the choice of loss function. When the segmentation process targets rare observations, a severe class imbalance is likely to occur between candidate labels, thus resulting in sub-optimal performance. In order to mitigate this issue, strategies such as the weighted cross-entropy function, the sensitivity function or the Dice loss function, have been proposed. In this work, we investigate the behavior of these loss functions and their sensitivity to learning rate tuning in the presence of different rates of label imbalance across 2D and 3D segmentation tasks. We also propose to use the class re-balancing properties of the Generalized Dice overlap, a known metric for segmentation assessment, as a robust and accurate deep-learning loss function for unbalanced tasks.
An Analysis of Loss Functions for Heavily Imbalanced Lesion Segmentation

Mariano Cabezas,Yago Diez

DOI: https://doi.org/10.3390/s24061981

IF: 3.9

2024-03-21

Sensors

Abstract:Heavily imbalanced datasets are common in lesion segmentation. Specifically, the lesions usually comprise less than 5% of the whole image volume when dealing with brain MRI. A common solution when training with a limited dataset is the use of specific loss functions that rebalance the effect of background and foreground voxels. These approaches are usually evaluated running a single cross-validation split without taking into account other possible random aspects that might affect the true improvement of the final metric (i.e., random weight initialisation or random shuffling). Furthermore, the evolution of the effect of the loss on the heavily imbalanced class is usually not analysed during the training phase. In this work, we present an analysis of different common loss metrics during training on public datasets dealing with brain lesion segmentation in heavy imbalanced datasets. In order to limit the effect of hyperparameter tuning and architecture, we chose a 3D Unet architecture due to its ability to provide good performance on different segmentation applications. We evaluated this framework on two public datasets and we observed that weighted losses have a similar performance on average, even though heavily weighting the gradient of the foreground class gives better performance in terms of true positive segmentation.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Segmentation with Multiple Acceptable Annotations: A Case Study of Myocardial Segmentation in Contrast Echocardiography

Dewen Zeng,Mingqi Li,Yukun Ding,Xiaowei Xu,Qiu Xie,Ruixue Xu,Hongwen Fei,Meiping Huang,Jian Zhuang,Yiyu Shi

DOI: https://doi.org/10.48550/arXiv.2106.15597

2021-06-30

Abstract:Most existing deep learning-based frameworks for image segmentation assume that a unique ground truth is known and can be used for performance evaluation. This is true for many applications, but not all. Myocardial segmentation of Myocardial Contrast Echocardiography (MCE), a critical task in automatic myocardial perfusion analysis, is an example. Due to the low resolution and serious artifacts in MCE data, annotations from different cardiologists can vary significantly, and it is hard to tell which one is the best. In this case, how can we find a good way to evaluate segmentation performance and how do we train the neural network? In this paper, we address the first problem by proposing a new extended Dice to effectively evaluate the segmentation performance when multiple accepted ground truth is available. Then based on our proposed metric, we solve the second problem by further incorporating the new metric into a loss function that enables neural networks to flexibly learn general features of myocardium. Experiment results on our clinical MCE data set demonstrate that the neural network trained with the proposed loss function outperforms those existing ones that try to obtain a unique ground truth from multiple annotations, both quantitatively and qualitatively. Finally, our grading study shows that using extended Dice as an evaluation metric can better identify segmentation results that need manual correction compared with using Dice.

Computer Vision and Pattern Recognition
Adaptive Region-Specific Loss for Improved Medical Image Segmentation

Yizheng Chen,Lequan Yu,Jen-Yeu Wang,Neil Panjwani,Jean-Pierre Obeid,Wu Liu,Lianli Liu,Nataliya Kovalchuk,Michael Francis Gensheimer,Lucas Kas Vitzthum,Beth M. Beadle,Daniel T. Chang,Quynh-Thu Le,Bin Han,Lei Xing

DOI: https://doi.org/10.1109/tpami.2023.3289667

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Defining the loss function is an important part of neural network design and critically determines the success of deep learning modeling. A significant shortcoming of the conventional loss functions is that they weight all regions in the input image volume equally, despite the fact that the system is known to be heterogeneous (i.e., some regions can achieve high prediction performance more easily than others). Here, we introduce a region-specific loss to lift the implicit assumption of homogeneous weighting for better learning. We divide the entire volume into multiple sub-regions, each with an individualized loss constructed for optimal local performance. Effectively, this scheme imposes higher weightings on the sub-regions that are more difficult to segment, and vice versa. Furthermore, the regional false positive and false negative errors are computed for each input image during a training step and the regional penalty is adjusted accordingly to enhance the overall accuracy of the prediction. Using different public and in-house medical image datasets, we demonstrate that the proposed regionally adaptive loss paradigm outperforms conventional methods in the multi-organ segmentations, without any modification to the neural network architecture or additional data preparation.

computer science, artificial intelligence,engineering, electrical & electronic
Generalized Dice Focal Loss trained 3D Residual UNet for Automated Lesion Segmentation in Whole-Body FDG PET/CT Images

Shadab Ahamed,Arman Rahmim

2023-09-24

Abstract:Automated segmentation of cancerous lesions in PET/CT images is a vital initial task for quantitative analysis. However, it is often challenging to train deep learning-based segmentation methods to high degree of accuracy due to the diversity of lesions in terms of their shapes, sizes, and radiotracer uptake levels. These lesions can be found in various parts of the body, often close to healthy organs that also show significant uptake. Consequently, developing a comprehensive PET/CT lesion segmentation model is a demanding endeavor for routine quantitative image analysis. In this work, we train a 3D Residual UNet using Generalized Dice Focal Loss function on the AutoPET challenge 2023 training dataset. We develop our models in a 5-fold cross-validation setting and ensemble the five models via average and weighted-average ensembling. On the preliminary test phase, the average ensemble achieved a Dice similarity coefficient (DSC), false-positive volume (FPV) and false negative volume (FNV) of 0.5417, 0.8261 ml, and 0.2538 ml, respectively, while the weighted-average ensemble achieved 0.5417, 0.8186 ml, and 0.2538 ml, respectively. Our algorithm can be accessed via this link: <a class="link-external link-https" href="https://github.com/ahxmeds/autosegnet" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Comparative biology of tropical Lethrinus species (Lethrinidae): challenges for multi-species management.

L. Currey,A. Williams,B. Mapstone,C. Davies,G. Carlos,D. Welch,C. Simpfendorfer,A. Ballagh,A. Penny,E. Grandcourt,A. Mapleston,A. Wiebkin,K. Bean

DOI: https://doi.org/10.1111/jfb.3495

2013-03-01

Journal of Fish Biology

Abstract:Life-history characteristics of six tropical Lethrinus species sampled from the Great Barrier Reef World Heritage Area were compared. Two species groups were identified based on fork length (LF ): large species with maximum LF > 640 mm (longface emperor Lethrinus olivaceus, yellowlip emperor Lethrinus xanthochilus and spangled emperor Lethrinus nebulosus) and small species with maximum LF < 480 mm (Pacific yellowtail emperor Lethrinus atkinsoni, pink ear emperor Lethrinus lentjan and ornate emperor Lethrinus ornatus). Lifespan was not correlated with LF . Early growth for all species was rapid and similar during the first few years of life, but coefficients of the von Bertalanffy growth function varied considerably among species. Growth also differed between sexes for L. atkinsoni. Reproductive characteristics varied among species, with peak periods of spawning occurring in November to December for L. atkinsoni, July to August for L. nebulous, September to October for L. olivaceus and a protracted season for L. lentjan, although fewer samples were available for the last two species. Sex-specific LF and age distributions and gonad histology of L. lentjan were suggestive of a functional protogynous reproductive pattern, as observed in other lethrinids. Gonad histology indicated non-functional protogynous hermaphroditism for L. atkinsoni and L. nebulosus. The diversity of life histories among these closely related species emphasizes the difficulty in devising single management strategies appropriate for multi-species fisheries and illustrates the importance of understanding species-specific life histories to infer responses to exploitation.
Offset Curves Loss for Imbalanced Problem in Medical Segmentation

Ngan Le,Trung Le,Kashu Yamazaki,Toan Duc Bui,Khoa Luu,Marios Savides

DOI: https://doi.org/10.48550/arXiv.2012.02463

2020-12-04

Abstract:Medical image segmentation has played an important role in medical analysis and widely developed for many clinical applications. Deep learning-based approaches have achieved high performance in semantic segmentation but they are limited to pixel-wise setting and imbalanced classes data problem. In this paper, we tackle those limitations by developing a new deep learning-based model which takes into account both higher feature level i.e. region inside contour, intermediate feature level i.e. offset curves around the contour and lower feature level i.e. contour. Our proposed Offset Curves (OsC) loss consists of three main fitting terms. The first fitting term focuses on pixel-wise level segmentation whereas the second fitting term acts as attention model which pays attention to the area around the boundaries (offset curves). The third terms plays a role as regularization term which takes the length of boundaries into account. We evaluate our proposed OsC loss on both 2D network and 3D network. Two common medical datasets, i.e. retina DRIVE and brain tumor BRATS 2018 datasets are used to benchmark our proposed loss performance. The experiments have shown that our proposed OsC loss function outperforms other mainstream loss functions such as Cross-Entropy, Dice, Focal on the most common segmentation networks Unet, FCN.

Image and Video Processing,Computer Vision and Pattern Recognition
Do we really need dice? The hidden region-size biases of segmentation losses

Bingyuan Liu,Jose Dolz,Adrian Galdran,Riadh Kobbi,Ismail Ben Ayed

DOI: https://doi.org/10.1016/j.media.2023.103015

Abstract:Most segmentation losses are arguably variants of the Cross-Entropy (CE) or Dice losses. On the surface, these two categories of losses (i.e., distribution based vs. geometry based) seem unrelated, and there is no clear consensus as to which category is a better choice, with varying performances for each across different benchmarks and applications. Furthermore, it is widely argued within the medical-imaging community that Dice and CE are complementary, which has motivated the use of compound CE-Dice losses. In this work, we provide a theoretical analysis, which shows that CE and Dice share a much deeper connection than previously thought. First, we show that, from a constrained-optimization perspective, they both decompose into two components, i.e., a similar ground-truth matching term, which pushes the predicted foreground regions towards the ground-truth, and a region-size penalty term imposing different biases on the size (or proportion) of the predicted regions. Then, we provide bound relationships and an information-theoretic analysis, which uncover hidden region-size biases: Dice has an intrinsic bias towards specific extremely imbalanced solutions, whereas CE implicitly encourages the ground-truth region proportions. Our theoretical results explain the wide experimental evidence in the medical-imaging literature, whereby Dice losses bring improvements for imbalanced segmentation. It also explains why CE dominates natural-image problems with diverse class proportions, in which case Dice might have difficulty adapting to different region-size distributions. Based on our theoretical analysis, we propose a principled and simple solution, which enables to control explicitly the region-size bias. The proposed method integrates CE with explicit terms based on L1 or the KL divergence, which encourage segmenting region proportions to match target class proportions, thereby mitigating class imbalance but without losing generality. Comprehensive experiments and ablation studies over different losses and applications validate our theoretical analysis, as well as the effectiveness of explicit and simple region-size terms. The code is available at https://github.com/by-liu/SegLossBias .
Improving Surgical Scene Semantic Segmentation through a Deep Learning Architecture with Attention to Class Imbalance

Claudio Urrea,Yainet Garcia-Garcia,John Kern

DOI: https://doi.org/10.3390/biomedicines12061309

IF: 4.757

2024-06-14

Biomedicines

Abstract:This article addresses the semantic segmentation of laparoscopic surgery images, placing special emphasis on the segmentation of structures with a smaller number of observations. As a result of this study, adjustment parameters are proposed for deep neural network architectures, enabling a robust segmentation of all structures in the surgical scene. The U-Net architecture with five encoder–decoders (U-Net5ed), SegNet-VGG19, and DeepLabv3+ employing different backbones are implemented. Three main experiments are conducted, working with Rectified Linear Unit (ReLU), Gaussian Error Linear Unit (GELU), and Swish activation functions. The applied loss functions include Cross Entropy (CE), Focal Loss (FL), Tversky Loss (TL), Dice Loss (DiL), Cross Entropy Dice Loss (CEDL), and Cross Entropy Tversky Loss (CETL). The performance of Stochastic Gradient Descent with momentum (SGDM) and Adaptive Moment Estimation (Adam) optimizers is compared. It is qualitatively and quantitatively confirmed that DeepLabv3+ and U-Net5ed architectures yield the best results. The DeepLabv3+ architecture with the ResNet-50 backbone, Swish activation function, and CETL loss function reports a Mean Accuracy (MAcc) of 0.976 and Mean Intersection over Union (MIoU) of 0.977. The semantic segmentation of structures with a smaller number of observations, such as the hepatic vein, cystic duct, Liver Ligament, and blood, verifies that the obtained results are very competitive and promising compared to the consulted literature. The proposed selected parameters were validated in the YOLOv9 architecture, which showed an improvement in semantic segmentation compared to the results obtained with the original architecture.

biochemistry & molecular biology,medicine, research & experimental,pharmacology & pharmacy
A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial

Shruti Jadon,Owen P. Leary,Ian Pan,Tyler J. Harder,David W. Wright,Lisa H. Merck,Derek L. Merck

DOI: https://doi.org/10.1117/12.2566332

2020-06-02

Abstract:Automated segmentation of medical imaging is of broad interest to clinicians and machine learning researchers alike. The goal of segmentation is to increase efficiency and simplicity of visualization and quantification of regions of interest within a medical image. Image segmentation is a difficult task because of multiparametric heterogeneity within the images, an obstacle that has proven especially challenging in efforts to automate the segmentation of brain lesions from non-contrast head computed tomography (CT). In this research, we have experimented with multiple available deep learning architectures to segment different phenotypes of hemorrhagic lesions found after moderate to severe traumatic brain injury (TBI). These include: intraparenchymal hemorrhage (IPH), subdural hematoma (SDH), epidural hematoma (EDH), and traumatic contusions. We were able to achieve an optimal Dice Coefficient1 score of 0.94 using UNet++ 2D Architecture with Focal Tversky Loss Function, an increase from 0.85 using UNet 2D with Binary Cross-Entropy Loss Function in intraparenchymal hemorrhage (IPH) cases. Furthermore, using the same setting, we were able to achieve the Dice Coefficient score of 0.90 and 0.86 in cases of Extra-Axial bleeds and Traumatic contusions, respectively.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
AutoPET Challenge III: Testing the Robustness of Generalized Dice Focal Loss trained 3D Residual UNet for FDG and PSMA Lesion Segmentation from Whole-Body PET/CT Images

Shadab Ahamed

2024-09-16

Abstract:Automated segmentation of cancerous lesions in PET/CT scans is a crucial first step in quantitative image analysis. However, training deep learning models for segmentation with high accuracy is particularly challenging due to the variations in lesion size, shape, and radiotracer uptake. These lesions can appear in different parts of the body, often near healthy organs that also exhibit considerable uptake, making the task even more complex. As a result, creating an effective segmentation model for routine PET/CT image analysis is challenging. In this study, we utilized a 3D Residual UNet model and employed the Generalized Dice Focal Loss function to train the model on the AutoPET Challenge 2024 dataset. We conducted a 5-fold cross-validation and used an average ensembling technique using the models from the five folds. In the preliminary test phase for Task-1, the average ensemble achieved a mean Dice Similarity Coefficient (DSC) of 0.6687, mean false negative volume (FNV) of 10.9522 ml and mean false positive volume (FPV) 2.9684 ml. More details about the algorithm can be found on our GitHub repository: <a class="link-external link-https" href="https://github.com/ahxmeds/autosegnet2024.git" rel="external noopener nofollow">this https URL</a>. The training code has been shared via the repository: <a class="link-external link-https" href="https://github.com/ahxmeds/autopet2024.git" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence,Medical Physics
A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentation

Nabila Abraham,Naimul Mefraz Khan

DOI: https://doi.org/10.48550/arXiv.1810.07842

2018-10-18

Abstract:We propose a generalized focal loss function based on the Tversky index to address the issue of data imbalance in medical image segmentation. Compared to the commonly used Dice loss, our loss function achieves a better trade off between precision and recall when training on small structures such as lesions. To evaluate our loss function, we improve the attention U-Net model by incorporating an image pyramid to preserve contextual features. We experiment on the BUS 2017 dataset and ISIC 2018 dataset where lesions occupy 4.84% and 21.4% of the images area and improve segmentation accuracy when compared to the standard U-Net by 25.7% and 3.6%, respectively.

Computer Vision and Pattern Recognition
Anatomical and Diagnostic Bayesian Segmentation in Prostate MRI $-$Should Different Clinical Objectives Mandate Different Loss Functions?

Anindo Saha,Joeran Bosma,Jasper Linmans,Matin Hosseinzadeh,Henkjan Huisman

DOI: https://doi.org/10.48550/arXiv.2110.12889

2021-10-25

Image and Video Processing

Abstract:We hypothesize that probabilistic voxel-level classification of anatomy and malignancy in prostate MRI, although typically posed as near-identical segmentation tasks via U-Nets, require different loss functions for optimal performance due to inherent differences in their clinical objectives. We investigate distribution, region and boundary-based loss functions for both tasks across 200 patient exams from the publicly-available ProstateX dataset. For evaluation, we conduct a thorough comparative analysis of model predictions and calibration, measured with respect to multi-class volume segmentation of the prostate anatomy (whole-gland, transitional zone, peripheral zone), as well as, patient-level diagnosis and lesion-level detection of clinically significant prostate cancer. Notably, we find that distribution-based loss functions (in particular, focal loss) are well-suited for diagnostic or panoptic segmentation tasks such as lesion detection, primarily due to their implicit property of inducing better calibration. Meanwhile, (with the exception of focal loss) both distribution and region/boundary-based loss functions perform equally well for anatomical or semantic segmentation tasks, such as quantification of organ shape, size and boundaries.
Segmentation Loss Odyssey

Jun Ma

DOI: https://doi.org/10.48550/arXiv.2005.13449

2020-05-28

Abstract:Loss functions are one of the crucial ingredients in deep learning-based medical image segmentation methods. Many loss functions have been proposed in existing literature, but are studied separately or only investigated with few other losses. In this paper, we present a systematic taxonomy to sort existing loss functions into four meaningful categories. This helps to reveal links and fundamental similarities between them. Moreover, we explore the relationship between the traditional region-based and the more recent boundary-based loss functions. The PyTorch implementations of these loss functions are publicly available at \url{<a class="link-external link-https" href="https://github.com/JunMa11/SegLoss" rel="external noopener nofollow">this https URL</a>}.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

Effect of tromethamine (THAM) on infarct volume following permanent middle cerebral artery occlusion in rats.

Optimization for Medical Image Segmentation: Theory and Practice when evaluating with Dice Score or Jaccard Index

Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice

Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation

A Generalized Surface Loss for Reducing the Hausdorff Distance in Medical Imaging Segmentation

Loss odyssey in medical image segmentation

Advancing precision in medical image segmentation: A performance analysis of loss functions for COVID‐19 lung infection segmentation in computed tomography images

Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations

An Analysis of Loss Functions for Heavily Imbalanced Lesion Segmentation

Segmentation with Multiple Acceptable Annotations: A Case Study of Myocardial Segmentation in Contrast Echocardiography

Adaptive Region-Specific Loss for Improved Medical Image Segmentation

Generalized Dice Focal Loss trained 3D Residual UNet for Automated Lesion Segmentation in Whole-Body FDG PET/CT Images

Comparative biology of tropical Lethrinus species (Lethrinidae): challenges for multi-species management.

Offset Curves Loss for Imbalanced Problem in Medical Segmentation

Do we really need dice? The hidden region-size biases of segmentation losses

Improving Surgical Scene Semantic Segmentation through a Deep Learning Architecture with Attention to Class Imbalance

A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial

AutoPET Challenge III: Testing the Robustness of Generalized Dice Focal Loss trained 3D Residual UNet for FDG and PSMA Lesion Segmentation from Whole-Body PET/CT Images

A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentation

Anatomical and Diagnostic Bayesian Segmentation in Prostate MRI $-$Should Different Clinical Objectives Mandate Different Loss Functions?

Segmentation Loss Odyssey