Abstract:Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this dilemma. Because existing medical contrastive learning strategies focus on extracting image-level representation, which ignores abundant multi-level representations. And they underutilize the decoder either by random initialization or separate pre-training from the encoder, thereby neglecting the potential collaboration between the encoder and decoder. To address these issues, we propose a novel multi-level asymmetric contrastive learning framework named MACL for volumetric medical image segmentation pre-training. Specifically, we design an asymmetric contrastive learning structure to pre-train encoder and decoder simultaneously to provide better initialization for segmentation models. Moreover, we develop a multi-level contrastive learning strategy that integrates correspondences across feature-level, image-level, and pixel-level representations to ensure the encoder and decoder capture comprehensive details from representations of varying scales and granularities during the pre-training phase. Finally, experiments on 12 volumetric medical image datasets indicate our MACL framework outperforms existing 11 contrastive learning strategies. {\itshape i.e.} Our MACL achieves a superior performance with more precise predictions from visualization figures and 2.28\%, 1.32\%, 1.62\% and 1.60\% Average Dice higher than previous best results on CHD, MMWHS, CHAOS and AMOS, respectively. And our MACL also has a strong generalization ability among 5 variant U-Net backbones. Our code will be available at <a class="link-external link-https" href="https://github.com/stevezs315/MACL" rel="external noopener nofollow">this https URL</a>.

Multi-Level Contrastive Student-Teacher Structure for Semi-Supervised Medical Image Segmentation

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Multi-modal contrastive mutual learning and pseudo-label re-learning for semi-supervised medical image segmentation

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Semantic-Aware Contrastive Learning for Multi-Object Medical Image Segmentation

Multi-level Asymmetric Contrastive Learning for Volumetric Medical Image Segmentation Pre-training

Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation

Curriculum Consistency Learning and Multi-Scale Contrastive Constraint in Semi-Supervised Medical Image Segmentation

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

The student-teacher framework guided by self-training and consistency regularization for semi-supervised medical image segmentation

Dual-stream-based dense local features contrastive learning for semi-supervised medical image segmentation

Localized Region Contrast for Enhancing Self-Supervised Learning in Medical Image Segmentation

Diversity matters: Cross-head mutual mean-teaching for semi-supervised medical image segmentation

Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning

Semisupervised Medical Image Segmentation through Prototype-Based Mutual Consistency Learning

Learning Semi-Supervised Medical Image Segmentation from Spatial Registration

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

Positional Contrastive Learning for Volumetric Medical Image Segmentation

Contrastive and Selective Hidden Embeddings for Medical Image Segmentation

Multi-Consistency Training for Semi-Supervised Medical Image Segmentation

Affinity-Graph-Guided Contractive Learning for Pretext-Free Medical Image Segmentation with Minimal Annotation