Abstract:A prevalent family of fully convolutional networks are capable of learning discriminative representations and producing structural prediction in semantic segmentation tasks. However, such supervised learning methods require a large amount of labeled data and show inability of learning cross-domain invariant representations, giving rise to overfitting performance on the source dataset. Domain adaptation, a transfer learning technique that demonstrates strength on aligning feature distributions, can improve the performance of learning methods by providing inter-domain discrepancy alleviation. Recently introduced output-space based adaptation methods provide significant advances on cross-domain semantic segmentation tasks, however, a lack of consideration for intra-domain divergence of domain discrepancy remains prone to over-adaptation results on the target domain. To address the problem, we first leverage prototypical knowledge on the target domain to relax its hard domain label to a continuous domain space, where pixel-wise domain adaptation is developed upon a soft adversarial loss. The development of prototypical knowledge allows to elaborate specific adaptation strategies on under-aligned regions and well-aligned regions of the target domain. Furthermore, aiming to achieve better adaptation performance, we employ a unilateral discriminator to alleviate implicit uncertainty on prototypical knowledge. At last, we theoretically and experimentally demonstrate that the proposed prototypical knowledge oriented adaptation approach provides effective guidance on distribution alignment and alleviation on over-adaptation. The proposed approach shows competitive performance with state-of-the-art methods on two cross-domain segmentation tasks.

Unsupervised Domain Adaption via Similarity-Based Prototypes for Cross-Modality Segmentation

Domain Adaptation Meets Zero-Shot Learning: an Annotation-Efficient Approach to Multi-Modality Medical Image Segmentation

Prototype-based Cross-cluster Unsupervised Domain Adaptation for Semantic Segmentation

A Prototypical Knowledge Oriented Adaptation Framework for Semantic Segmentation

Unsupervised Adaptive Lesion Segmentation with Similarity Based Cross Pseudo Supervision

Contrast, Stylize and Adapt: Unsupervised Contrastive Learning Framework for Domain Adaptive Semantic Segmentation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Unsupervised Pixel-Wise Weighted Adversarial Domain Adaptation

Domain-invariant Prototypes for Semantic Segmentation

Unsupervised Domain Adaptation Network with Category-Centric Prototype Aligner for Biomedical Image Segmentation

Unsupervised Urban Scene Segmentation Via Domain Adaptation

Unsupervised Domain Adaptation for Medical Image Segmentation by Selective Entropy Constraints and Adaptive Semantic Alignment

Unsupervised Domain Adaptive Semantic Segmentation Based on Clip-Guided Prototypical Contrastive Learning

Prototype-guided Unsupervised Domain Adaptation for Semantic Segmentation

10.1109/ICIPMC62364.2024.10586680 Unsupervised Domain Adaptation for Cross-Modality Cardiac Image Segmentation Based on Contrastive Image Synthesis

Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss

Cross-Modal Contrastive Learning for Domain Adaptation in 3D Semantic Segmentation.

Deep Symmetric Adaptation Network for Cross-Modality Medical Image Segmentation

Adversarial Domain Adaptation with a Domain Similarity Discriminator for Semantic Segmentation of Urban Areas

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

Cross-Modal Learning for Domain Adaptation in 3D Semantic Segmentation