Abstract:Deep learning requires a large amount of data to perform well. However, the field of medical image analysis suffers from a lack of sufficient data for training deep learning models. Moreover, medical images require manual labeling, usually provided by human annotators coming from various backgrounds. More importantly, the annotation process is time-consuming, expensive, and prone to errors. Transfer learning was introduced to reduce the need for the annotation process by transferring the deep learning models with knowledge from a previous task and then by fine-tuning them on a relatively small dataset of the current task. Most of the methods of medical image classification employ transfer learning from pretrained models, e.g., ImageNet, which has been proven to be ineffective. This is due to the mismatch in learned features between the natural image, e.g., ImageNet, and medical images. Additionally, it results in the utilization of deeply elaborated models. In this paper, we propose a novel transfer learning approach to overcome the previous drawbacks by means of training the deep learning model on large unlabeled medical image datasets and by next transferring the knowledge to train the deep learning model on the small amount of labeled medical images. Additionally, we propose a new deep convolutional neural network (DCNN) model that combines recent advancements in the field. We conducted several experiments on two challenging medical imaging scenarios dealing with skin and breast cancer classification tasks. According to the reported results, it has been empirically proven that the proposed approach can significantly improve the performance of both classification scenarios. In terms of skin cancer, the proposed model achieved an F1-score value of 89.09% when trained from scratch and 98.53% with the proposed approach. Secondly, it achieved an accuracy value of 85.29% and 97.51%, respectively, when trained from scratch and using the proposed approach in the case of the breast cancer scenario. Finally, we concluded that our method can possibly be applied to many medical imaging problems in which a substantial amount of unlabeled image data is available and the labeled image data is limited. Moreover, it can be utilized to improve the performance of medical imaging tasks in the same domain. To do so, we used the pretrained skin cancer model to train on feet skin to classify them into two classes—either normal or abnormal (diabetic foot ulcer (DFU)). It achieved an F1-score value of 86.0% when trained from scratch, 96.25% using transfer learning, and 99.25% using double-transfer learning.

Surrogate Supervision for Medical Image Analysis: Effective Deep Learning From Limited Quantities of Labeled Data

Data efficient deep learning for medical image analysis: A survey

Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models

3D Self-Supervised Methods for Medical Imaging

Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions

Transfer learning for medical images analyses: A survey

Contrastive self-supervised learning from 100 million medical images with optional supervision

Positional Information is a Strong Supervision for Volumetric Medical Image Segmentation

Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis

Self-supervised learning for medical image analysis: a comprehensive review

Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysis

Learning with Limited Annotations: A Survey on Deep Semi-Supervised Learning for Medical Image Segmentation

Self-supervision for medical image classification: state-of-the-art performance with ~100 labeled training samples per class

Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

Supervised Transfer Learning at Scale for Medical Imaging

Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Images

Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data

Self-supervised learning framework application for medical image analysis: a review and summary

Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Models

Big Self-Supervised Models Advance Medical Image Classification

Contrastive learning of global and local features for medical image segmentation with limited annotations