Abstract:Medical image segmentation has seen significant progress through the use of supervised deep learning. Hereby, large annotated datasets were employed to reliably segment anatomical structures. To reduce the requirement for annotated training data, self-supervised pre-training strategies on non-annotated data were designed. Especially contrastive learning schemes operating on dense pixel-wise representations have been introduced as an effective tool. In this work, we expand on this strategy and leverage inherent anatomical similarities in medical imaging data. We apply our approach to the task of semantic segmentation in a semi-supervised setting with limited amounts of annotated volumes. Trained alongside a segmentation loss in one single training stage, a contrastive loss aids to differentiate between salient anatomical regions that conform to the available annotations. Our approach builds upon the work of Jabri et al. (2020), who proposed cyclical contrastive random walks (CCRW) for self-supervision on palindromes of video frames. We adapt this scheme to operate on entries of paired embedded image slices. Using paths of cyclical random walks bypasses the need for negative samples, as commonly used in contrastive approaches, enabling the algorithm to discriminate among relevant salient (anatomical) regions implicitly. Further, a multi-level supervision strategy is employed, ensuring adequate representations of local and global characteristics of anatomical structures. The effectiveness of reducing the amount of required annotations is shown on three MRI datasets. A median increase of 8.01 and 5.90 pp in the Dice Similarity Coefficient (DSC) compared to our baseline could be achieved across all three datasets in the case of one and two available annotated examples per dataset.

Self-supervised Contrastive Learning with Random Walks for Medical Image Segmentation with limited Annotations

Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation

Contrastive learning of global and local features for medical image segmentation with limited annotations

Contrastive Semi-Supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures

Contrastive and Selective Hidden Embeddings for Medical Image Segmentation

Localized Region Contrast for Enhancing Self-Supervised Learning in Medical Image Segmentation

Curriculum Consistency Learning and Multi-Scale Contrastive Constraint in Semi-Supervised Medical Image Segmentation

Weakly Supervised Medical Image Segmentation Via Superpixel-Guided Scribble Walking and Class-Wise Contrastive Regularization.

Leveraging Unlabeled Data for 3D Medical Image Segmentation through Self-Supervised Contrastive Learning

GLRP: Global and Local Contrastive Learning Based on Relative Position for Medical Image Segmentation on Cardiac MRI

Affinity-Graph-Guided Contractive Learning for Pretext-Free Medical Image Segmentation with Minimal Annotation

Learning Semi-Supervised Medical Image Segmentation from Spatial Registration

Semantic-Aware Contrastive Learning for Multi-Object Medical Image Segmentation

Multi-Level Contrastive Student-Teacher Structure for Semi-Supervised Medical Image Segmentation

Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

Multi-level Asymmetric Contrastive Learning for Medical Image Segmentation Pre-training

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Positional Information is a Strong Supervision for Volumetric Medical Image Segmentation

Self-Supervised Alignment Learning for Medical Image Segmentation