Abstract:It plays a significant role to accurately and automatically segment lesions from ultrasound (US) images in clinical application. Nevertheless, it is extremely challenging because distinct components of heterogeneous lesions are similar to background in US images. In our study, a transfer learning-based method is developed for full-automatic joint segmentation of nodular lesions. Transfer learning is a widely used method to build high performing computer vision models. Our transfer learning model is a novel type of densely connected convolutional network (SDenseNet). Specifically, we pre-train SDenseNet based on ImageNet dataset. Then our SDenseNet is designed as a multi-channel model (denoted Mul-DenseNet) for automatically jointly segmenting lesions. As comparison, our SDenseNet using different transfer learning is applied to segmenting nodules, respectively. In our study, we find that more datasets for pre-training and multiple pre-training do not always work in segmentation of nodules, and the performance of transfer learning depends on a judicious choice of dataset and characteristics of targets. Experimental results illustrate a significant performance of the Mul-DenseNet compared to that of other methods in the study. Specially, for thyroid nodule segmentation, overlap metric (OM), dice ratio (DR), true-positive rate (TPR), false-positive rate (FPR) and modified Hausdorff distance (MHD) are $$0.9257\pm 0.0027$$ , $$0.9596\pm 0.0009$$ , $$0.9869\pm 0.0008$$ , $$0.0183\pm 0.0066$$ and $$0.3897\pm 0.3488$$ mm, respectively; for breast nodule segmentation, OM, DR, TPR, FPR and MHD are $$0.8912\pm 0.0072$$ , $$0.9513\pm 0.0038$$ , $$0.9835\pm 0.0015$$ , $$0.2381\pm 0.1301$$ and $$0.2017\pm 0.0302$$ mm, respectively. The experimental results illustrate our transfer learning models are very effective in segmentation of lesions, which also demonstrate that it is potential of our proposed Mul-DenseNet model in clinical applications. This model can reduce heavy workload of the physicians so that it can avoid misdiagnosis cases due to excessive fatigue. Moreover, it is easy and reproducible to detect lesions without medical expertise.

Transfer Learning For Surgical Task Segmentation

"Train one, Classify one, Teach one" -- Cross-surgery transfer learning for surgical step recognition

Transfer Learning for KiTS21 Challenge

Hierarchical Semi-Supervised Learning Framework for Surgical Gesture Segmentation and Recognition Based on Multi-Modality Data

Transfer learning for anatomical structure segmentation in otorhinolaryngology microsurgery

Finding the Most Transferable Tasks for Brain Image Segmentation

Selecting the Best Sequential Transfer Path for Medical Image Segmentation with Limited Labeled Data

Transfer Learning for Automatic Joint Segmentation of Thyroid and Breast Lesions from Ultrasound Images.

Enhanced Medical Image Segmentation using Transfer Learning with Res101_UNet: Experimental Insights and Comparative Performance Analysis

Tumor Segmentation in Intraoperative Fluorescence Images Based on Transfer Learning and Convolutional Neural Networks

Multi-task Learning for Segmentation and Classification of Tumors in 3D Automated Breast Ultrasound Images

Pick the Best Pre-trained Model: Towards Transferability Estimation for Medical Image Segmentation

Transfer Learning U-Net Deep Learning for Lung Ultrasound Segmentation

Surgical Scene Segmentation by Transformer With Asymmetric Feature Enhancement

Task segmentation based on transition state clustering for surgical robot assistance

Partial Labeled Gastric Tumor Segmentation via patch-based Reiterative Learning

Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognition

LSKANet: Long Strip Kernel Attention Network for Robotic Surgical Scene Segmentation

Transfer learning from a sparsely annotated dataset of 3D medical images

Generalizing Surgical Instruments Segmentation to Unseen Domains with One-to-Many Synthesis

Strategies to Improve Real-World Applicability of Laparoscopic Anatomy Segmentation Models