Abstract:Transfer learning has gained importance in areas where there is a labeled data shortage. However, it is still controversial as to what extent natural image datasets as pre-training sources contribute scientifically to success in different fields, such as medical imaging. In this study, the effect of transfer learning for medical object detection was quantitatively compared using natural and medical image datasets. Within the scope of this study, transfer learning strategies based on five different weight initialization methods were discussed. A natural image dataset MS COCO and brain tumor dataset BraTS 2020 were used as the transfer learning source, and Gazi Brains 2020 was used for the target. Mask R-CNN was adopted as a deep learning architecture for its capability to effectively handle both object detection and segmentation tasks. The experimental results show that transfer learning from the medical image dataset was found to be 10% more successful and showed 24% better convergence performance than the MS COCO pre-trained model, although it contains fewer data. While the effect of data augmentation on the natural image pre-trained model was 5%, the same domain pre-trained model was measured as 2%. According to the most widely used object detection metric, transfer learning strategies using MS COCO weights and random weights showed the same object detection performance as data augmentation. The performance of the most effective strategies identified in the Mask R-CNN model was also tested with YOLOv8. Results showed that even if the amount of data is less than the natural dataset, in-domain transfer learning is more efficient than cross-domain transfer learning. Moreover, this study demonstrates the first use of the Gazi Brains 2020 dataset, which was generated to address the lack of labeled and qualified brain MRI data in the medical field for in-domain transfer learning. Thus, knowledge transfer was carried out from the deep neural network, which was trained with brain tumor data and tested on a different brain tumor dataset.

Weakly supervised learning in domain transfer scenario for brain lesion segmentation in MRI

Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation

ADAPTIVE TRANSFER LEARNING TO ENHANCE DOMAIN TRANSFER IN BRAIN TUMOR SEGMENTATION

Domain Specific, Semi-Supervised Transfer Learning for Medical Imaging

Weakly supervised brain tumor segmentation via semantic affinity deep neural network

Transfer Learning from Partial Annotations for Whole Brain Segmentation

Learning Domain Transfer for Unsupervised Magnetic Resonance Imaging Restoration and Edge Enhancement

Meta-Analysis of Transfer Learning for Segmentation of Brain Lesions

Weakly Supervised Deep Learning for Brain Disease Prognosis Using MRI and Incomplete Clinical Scores

Weakly supervised deep learning model with size constraint for prostate cancer detection in multiparametric MRI and generalization to unseen domains

In-Domain Transfer Learning Strategy for Tumor Detection on Brain MRI

SSL2: self-supervised learning meets semi-supervised learning: multiple sclerosis segmentation in 7T-MRI from large-scale 3T-MRI

Weakly-Supervised White and Grey Matter Segmentation in 3D Brain Ultrasound

Contrastive learning of global and local features for medical image segmentation with limited annotations

SSL^2: Self-Supervised Learning meets Semi-Supervised Learning: Multiple Sclerosis Segmentation in 7T-MRI from large-scale 3T-MRI

Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data

Deep Learning and Transfer Learning for Brain Tumor Detection and Classification

Segmentation of brain lesions from CT images based on deep learning techniques.

Robust Segmentation of Brain MRI in the Wild with Hierarchical CNNs and no Retraining

Compound attention embedded dual channel encoder-decoder for ms lesion segmentation from brain MRI

Transfer Learning Approaches for Brain Metastases Screenings