Abstract:Deep learning requires a large amount of data to perform well. However, the field of medical image analysis suffers from a lack of sufficient data for training deep learning models. Moreover, medical images require manual labeling, usually provided by human annotators coming from various backgrounds. More importantly, the annotation process is time-consuming, expensive, and prone to errors. Transfer learning was introduced to reduce the need for the annotation process by transferring the deep learning models with knowledge from a previous task and then by fine-tuning them on a relatively small dataset of the current task. Most of the methods of medical image classification employ transfer learning from pretrained models, e.g., ImageNet, which has been proven to be ineffective. This is due to the mismatch in learned features between the natural image, e.g., ImageNet, and medical images. Additionally, it results in the utilization of deeply elaborated models. In this paper, we propose a novel transfer learning approach to overcome the previous drawbacks by means of training the deep learning model on large unlabeled medical image datasets and by next transferring the knowledge to train the deep learning model on the small amount of labeled medical images. Additionally, we propose a new deep convolutional neural network (DCNN) model that combines recent advancements in the field. We conducted several experiments on two challenging medical imaging scenarios dealing with skin and breast cancer classification tasks. According to the reported results, it has been empirically proven that the proposed approach can significantly improve the performance of both classification scenarios. In terms of skin cancer, the proposed model achieved an F1-score value of 89.09% when trained from scratch and 98.53% with the proposed approach. Secondly, it achieved an accuracy value of 85.29% and 97.51%, respectively, when trained from scratch and using the proposed approach in the case of the breast cancer scenario. Finally, we concluded that our method can possibly be applied to many medical imaging problems in which a substantial amount of unlabeled image data is available and the labeled image data is limited. Moreover, it can be utilized to improve the performance of medical imaging tasks in the same domain. To do so, we used the pretrained skin cancer model to train on feet skin to classify them into two classes—either normal or abnormal (diabetic foot ulcer (DFU)). It achieved an F1-score value of 86.0% when trained from scratch, 96.25% using transfer learning, and 99.25% using double-transfer learning.

On combining active and transfer learning for medical data classification

Learning Based Combining Different Features for Medical Image Retrieval

Federated Active Learning for Multicenter Collaborative Disease Diagnosis

Batch Mode Active Learning and Its Application to Medical Image Classification

On the Effective Transfer Learning Strategy for Medical Image Analysis in Deep Learning

PCDAL: A Perturbation Consistency-Driven Active Learning Approach for Medical Image Segmentation and Classification

On Gleaning Knowledge from Multiple Domains for Active Learning

Focused Active Learning for Histopathological Image Classification

An Adaptive Query Approach for Extracting Medical Images for Disease Detection Applications

Active Learning with Cross-Class Similarity Transfer.

Su-Sampling Based Active Learning for Large-Scale Histopathology Image.

Deep Similarity-Based Batch Mode Active Learning with Exploration-Exploitation.

Classifier Combination Based on Active Learning

Active Learning on Medical Image

Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data

Active learning for medical code assignment

Triplet attention and dual-pool contrastive learning for clinic-driven multi-label medical image classification

On Combining Biclustering Mining and AdaBoost for Breast Tumor Classification

Deep active learning for classifying cancer pathology reports

An Iterative Transfer Learning Based Classification Framework

Patient Aware Active Learning for Fine-Grained OCT Classification