Abstract:A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are abundant and easy to acquire. Self-supervised learning (SSL) has shown great potentials in exploiting raw data information and representation learning. In this paper, we propose Hierarchical Self-Supervised Learning (HSSL), a new self-supervised framework that boosts medical image segmentation by making good use of unannotated data. Unlike the current literature on task-specific self-supervised pretraining followed by supervised fine-tuning, we utilize SSL to learn task-agnostic knowledge from heterogeneous data for various medical image segmentation tasks. Specifically, we first aggregate a dataset from several medical challenges, then pre-train the network in a self-supervised manner, and finally fine-tune on labeled data. We develop a new loss function by combining contrastive loss and classification loss, and pre-train an encoder-decoder architecture for segmentation tasks. Our extensive experiments show that multi-domain joint pre-training benefits downstream segmentation tasks and outperforms single-domain pre-training significantly. Compared to learning from scratch, our method yields better performance on various tasks (e.g., +0.69%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$+0.69\%$$end{document} to +18.60%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$+18.60\%$$end{document} in Dice with 5%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$5\%$$end{document} of annotated data). With limited amounts of training data, our method can substantially bridge the performance gap with respect to denser annotations (e.g., 10%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$10\%$$end{document} vs. 100%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$100\%$$end{document} annotations).

Self-supervised Learning for Few-shot Medical Image Segmentation

Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation

Self-supervised Few-shot Learning for Semantic Segmentation: An Annotation-free Approach

PoissonSeg: Semi-Supervised Few-Shot Medical Image Segmentation via Poisson Learning

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

DINOv2 based Self Supervised Learning For Few Shot Medical Image Segmentation

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

A dynamic few-shot learning framework for medical image stream mining based on self-training

Hierarchical Self-supervised Learning for Medical Image Segmentation Based on Multi-domain Data Aggregation

Few-Shot Medical Image Segmentation with High-Fidelity Prototypes

Low-Quality Sensor Data-Based Semi-Supervised Learning for Medical Image Segmentation

Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Models

Semi-Supervised Few-Shot Segmentation with Noisy Support Images

Self-Supervised Alignment Learning for Medical Image Segmentation

Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learning

Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learning

Anomaly detection-inspired few-shot medical image segmentation through self-supervision with supervoxels

Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotation

Learning what and where to segment: A new perspective on medical image few-shot segmentation

Blessing Few-Shot Segmentation Via Semi-Supervised Learning with Noisy Support Images

SSNet: Learning Self-Similarity for Few-Shot Semantic Segmentation.