Abstract:Domain Adaption tasks have recently attracted substantial attention in computer vision as they improve the transferability of deep network models from a source to a target domain with different characteristics. A large body of state-of-the-art domain-adaptation methods was developed for image classification purposes, which may be inadequate for segmentation tasks. We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions. Such knowledge may take the form of anatomical information, for instance, structure size or shape, which can be known a priori or learned from the source samples via an auxiliary task. Our general formulation imposes inequality constraints on the network predictions of unlabeled or weakly labeled target samples, thereby matching implicitly the prediction statistics of the target and source domains, with permitted uncertainty of prior knowledge. Furthermore, our inequality constraints easily integrate weak annotations of the target data, such as image-level tags. We address the ensuing constrained optimization problem with differentiable penalties, fully suited for conventional stochastic gradient descent approaches. Unlike common two-step adversarial training, our formulation is based on a single segmentation network, which simplifies adaptation, while improving training quality. Comparison with state-of-the-art adaptation methods reveals considerably better performance of our model on two challenging tasks. Particularly, it consistently yields a performance gain of 1-4% Dice across architectures and datasets. Our results also show robustness to imprecision in the prior knowledge. The versatility of our novel approach can be readily used in various segmentation problems, with code available publicly.

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Contrast, Stylize and Adapt: Unsupervised Contrastive Learning Framework for Domain Adaptive Semantic Segmentation

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

Domain Adaptation for Structured Output via Discriminative Patch Representations

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Unsupervised Domain Adaptation for Semantic Segmentation via Low-level Edge Information Transfer

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.

Class-conditional domain adaptation for semantic segmentation

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

Unsupervised Domain Adaptation for Point Cloud Semantic Segmentation via Graph Matching

Semi-supervised Domain Adaptation for Semantic Segmentation

Affinity Space Adaptation for Semantic Segmentation Across Domains

Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimation

Constrained Domain Adaptation for Image Segmentation

Prototypical Contrast Adaptation for Domain Adaptive Semantic Segmentation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Adaptation in Semantic Segmentation