Abstract:Domain shift happens in cross-domain scenarios commonly because of the wide gaps between different domains: when applying a deep learning model well-trained in one domain to another target domain, the model usually performs poorly. To tackle this problem, unsupervised domain adaptation (UDA) techniques are proposed to bridge the gap between different domains, for the purpose of improving model performance without annotation in the target domain. Particularly, UDA has a great value for multimodal medical image analysis, where annotation difficulty is a practical concern. However, most existing UDA methods can only achieve satisfactory improvements in one adaptation direction (e.g., MRI to CT), but often perform poorly in the other (CT to MRI), limiting their practical usage. In this paper, we propose a bidirectional UDA (BiUDA) framework based on disentangled representation learning for equally competent two-way UDA performances. This framework employs a unified domain-aware pattern encoder which not only can adaptively encode images in different domains through a domain controller, but also improve model efficiency by eliminating redundant parameters. Furthermore, to avoid distortion of contents and patterns of input images during the adaptation process, a content-pattern consistency loss is introduced. Additionally, for better UDA segmentation performance, a label consistency strategy is proposed to provide extra supervision by recomposing target-domain-styled images and corresponding source-domain annotations. Comparison experiments and ablation studies conducted on two public datasets demonstrate the superiority of our BiUDA framework to current state-of-the-art UDA methods and the effectiveness of its novel designs. By successfully addressing two-way adaptations, our BiUDA framework offers a flexible solution of UDA techniques to the real-world scenario.

PANDA: A Polarized Attention Network for Enhanced Unsupervised Domain Adaptation in Semantic Segmentation

A New Bidirectional Unsupervised Domain Adaptation Segmentation Framework

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images

Look at the Neighbor: Distortion-aware Unsupervised Domain Adaptation for Panoramic Semantic Segmentation

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Affinity Space Adaptation for Semantic Segmentation Across Domains

Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer

Adversarial unsupervised domain adaptation for 3D semantic segmentation with multi-modal learning

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Style Adaptation for Domain-adaptive Semantic Segmentation

Unsupervised Adaptation of Polyp Segmentation Models via Coarse-to-Fine Self-Supervision

CATEGORY-ADAPTIVE DOMAIN ADAPTATION FOR SEMANTIC SEGMENTATION

Semi-supervised Domain Adaptation for Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

Unsupervised Domain Adaptation Augmented by Mutually Boosted Attention for Semantic Segmentation of VHR Remote Sensing Images

Polarized Attention Weak Supervised Semantic Segmentation Network

Category Anchor-Guided Unsupervised Domain Adaptation for Semantic Segmentation

Unsupervised Domain Adaptation in Semantic Segmentation Based on Pixel Alignment and Self-Training

Unsupervised domain adaptive segmentation algorithm based on two-level category alignment