Abstract:Abstract Deep learning in medical imaging has the potential to minimize the risk of diagnostic errors, reduce radiologist workload, and accelerate diagnosis. Training such deep learning models requires large and accurate datasets, with annotations for all training samples. However, in the medical imaging domain, annotated datasets for specific tasks are often small due to the high complexity of annotations, limited access, or the rarity of diseases. To address this challenge, deep learning models can be pre-trained on large image datasets without annotations using methods from the field of self-supervised learning. After pre-training, small annotated datasets are sufficient to fine-tune the models for a specific task. The most popular self-supervised pre-training approaches in medical imaging are based on contrastive learning. However, recent studies in natural image processing indicate a strong potential for masked autoencoder approaches. Our work compares state-of-the-art contrastive learning methods with the recently introduced masked autoencoder approach “SparK” for convolutional neural networks (CNNs) on medical images. Therefore, we pre-train on a large unannotated CT image dataset and fine-tune on several CT classification tasks. Due to the challenge of obtaining sufficient annotated training data in medical imaging, it is of particular interest to evaluate how the self-supervised pre-training methods perform when fine-tuning on small datasets. By experimenting with gradually reducing the training dataset size for fine-tuning, we find that the reduction has different effects depending on the type of pre-training chosen. The SparK pre-training method is more robust to the training dataset size than the contrastive methods. Based on our results, we propose the SparK pre-training for medical imaging tasks with only small annotated datasets.

Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysis

Self-Supervised Pretraining for 2D Medical Image Segmentation

Big Self-Supervised Models Advance Medical Image Classification

Self-supervised Learning for Chest CT - Training Strategies and Effect on Downstream Applications

Self-supervised learning framework application for medical image analysis: a review and summary

Contrastive self-supervised learning from 100 million medical images with optional supervision

Self-supervised learning for medical image analysis: a comprehensive review

Self-supervised learning for medical image analysis using image context restoration

Self-supervised learning for skin cancer diagnosis with limited training data

Self-supervision for medical image classification: state-of-the-art performance with ~100 labeled training samples per class

A survey of the impact of self-supervised pretraining for diagnostic tasks in medical X-ray, CT, MRI, and ultrasound

A Comparison of Self-Supervised Pretraining Approaches for Predicting Disease Risk from Chest Radiograph Images

Improving Medical Image Classification in Noisy Labels Using Only Self-supervised Pretraining

Resource and data efficient self supervised learning

Self-supervised learning for medical image classification: a systematic review and implementation guidelines

Exploring a Universal Training Method for Medical Image Classification.

Can we Adopt Self-supervised Pretraining for Chest X-Rays?

A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Images

Self-supervised pre-training with contrastive and masked autoencoder methods for dealing with small datasets in deep learning for medical imaging

Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition

Self-supervised multi-task learning for medical image analysis