Abstract:Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this dilemma. Because existing medical contrastive learning strategies focus on extracting image-level representation, which ignores abundant multi-level representations. And they underutilize the decoder either by random initialization or separate pre-training from the encoder, thereby neglecting the potential collaboration between the encoder and decoder. To address these issues, we propose a novel multi-level asymmetric contrastive learning framework named MACL for volumetric medical image segmentation pre-training. Specifically, we design an asymmetric contrastive learning structure to pre-train encoder and decoder simultaneously to provide better initialization for segmentation models. Moreover, we develop a multi-level contrastive learning strategy that integrates correspondences across feature-level, image-level, and pixel-level representations to ensure the encoder and decoder capture comprehensive details from representations of varying scales and granularities during the pre-training phase. Finally, experiments on 12 volumetric medical image datasets indicate our MACL framework outperforms existing 11 contrastive learning strategies. {\itshape i.e.} Our MACL achieves a superior performance with more precise predictions from visualization figures and 2.28\%, 1.32\%, 1.62\% and 1.60\% Average Dice higher than previous best results on CHD, MMWHS, CHAOS and AMOS, respectively. And our MACL also has a strong generalization ability among 5 variant U-Net backbones. Our code will be available at <a class="link-external link-https" href="https://github.com/stevezs315/MACL" rel="external noopener nofollow">this https URL</a>.

Combining Contrastive Learning and Shape Awareness for Semi-Supervised Medical Image Segmentation

Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

Unified Feature Consistency of Under-Performing Pixels and Valid Regions for Semi-Supervised Medical Image Segmentation

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

Shape-Guided Dual Consistency Semi-Supervised Learning Framework for 3-D Medical Image Segmentation

Learning Semi-Supervised Medical Image Segmentation from Spatial Registration

Shape-aware Multi-task Learning for Semi-supervised 3D Medical Image Segmentation.

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

Multi-Level Contrastive Student-Teacher Structure for Semi-Supervised Medical Image Segmentation

Semi-Supervised 3D Medical Image Segmentation Using Shape-Guided Dual Consistency Learning

SamDSK: Combining Segment Anything Model with Domain-Specific Knowledge for Semi-Supervised Learning in Medical Image Segmentation

Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning

Semi-supervised Medical Image Segmentation through Dual-task Consistency

Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

Semi-supervised Medical Image Segmentation via Hard Positives oriented Contrastive Learning

Contour-aware Consistency for Semi-Supervised Medical Image Segmentation

Dual-stream-based dense local features contrastive learning for semi-supervised medical image segmentation

Robust Semi-supervised 3D Medical Image Segmentation with Diverse Joint-task Learning and Decoupled Inter-student Learning

Multi-level Asymmetric Contrastive Learning for Volumetric Medical Image Segmentation Pre-training