Abstract:Multi-modal medical image segmentation has achieved great success through supervised deep learning networks. However, because of domain shift and limited annotation information, unpaired cross-modality segmentation tasks are still challenging. The unsupervised domain adaptation (UDA) methods can alleviate the segmentation degradation of cross-modality segmentation by knowledge transfer between different domains, but current methods still suffer from the problems of model collapse, adversarial training instability, and mismatch of anatomical structures. To tackle these issues, we propose a bidirectional multilayer contrastive adaptation network (BMCAN) for unpaired cross-modality segmentation. The shared encoder is first adopted for learning modality-invariant encoding representations in image synthesis and segmentation simultaneously. Secondly, to retain the anatomical structure consistency in cross-modality image synthesis, we present a structure-constrained cross-modality image translation approach for image alignment. Thirdly, we construct a bidirectional multilayer contrastive learning approach to preserve the anatomical structures and enhance encoding representations, which utilizes two groups of domain-specific multilayer perceptron (MLP) networks to learn modality-specific features. Finally, a semantic information adversarial learning approach is designed to learn structural similarities of semantic outputs for output space alignment. Our proposed method was tested on three different cross-modality segmentation tasks: brain tissue, brain tumor, and cardiac substructure segmentation. Compared with other UDA methods, experimental results show that our proposed BMCAN achieves state-of-the-art segmentation performance on the above three tasks, and it has fewer training components and better feature representations for overcoming overfitting and domain shift problems. Our proposed method can efficiently reduce the annotation burden of radiologists in cross-modality image analysis.

Contrastive Semi-Supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures

Contrastive Semi-supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures

SS-CADA: A Semi-Supervised Cross-Anatomy Domain Adaptation for Coronary Artery Segmentation

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

Self-supervised Contrastive Learning with Random Walks for Medical Image Segmentation with limited Annotations

Contrastive learning of global and local features for medical image segmentation with limited annotations

A bidirectional multilayer contrastive adaptation network with anatomical structure preservation for unpaired cross-modality medical image segmentation

Unsupervised Domain Adaptation for Cross-Modality Cardiac Image Segmentation Based on Contrastive Image Synthesis

Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation

Unsupervised Adaptive Lesion Segmentation with Similarity Based Cross Pseudo Supervision

Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

10.1109/ICIPMC62364.2024.10586680 Unsupervised Domain Adaptation for Cross-Modality Cardiac Image Segmentation Based on Contrastive Image Synthesis

Unsupervised Cross-modality Adaptation via Dual Structural-Oriented Guidance for 3D Medical Image Segmentation

CDDSA: Contrastive domain disentanglement and style augmentation for generalizable medical image segmentation

Self-Supervised Pre-Training Based on Contrastive Complementary Masking for Semi-Supervised Cardiac Image Segmentation

Semi-supervised Domain Adaptive Medical Image Segmentation through Consistency Regularized Disentangled Contrastive Learning

Unsupervised Domain Adaptation Network with Category-Centric Prototype Aligner for Biomedical Image Segmentation

Unsupervised Domain Adaptation by Cross-Prototype Contrastive Learning for Medical Image Segmentation.

Combining Contrastive Learning and Shape Awareness for Semi-Supervised Medical Image Segmentation

An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography