Abstract:Domain Adaption tasks have recently attracted substantial attention in computer vision as they improve the transferability of deep network models from a source to a target domain with different characteristics. A large body of state-of-the-art domain-adaptation methods was developed for image classification purposes, which may be inadequate for segmentation tasks. We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions. Such knowledge may take the form of anatomical information, for instance, structure size or shape, which can be known a priori or learned from the source samples via an auxiliary task. Our general formulation imposes inequality constraints on the network predictions of unlabeled or weakly labeled target samples, thereby matching implicitly the prediction statistics of the target and source domains, with permitted uncertainty of prior knowledge. Furthermore, our inequality constraints easily integrate weak annotations of the target data, such as image-level tags. We address the ensuing constrained optimization problem with differentiable penalties, fully suited for conventional stochastic gradient descent approaches. Unlike common two-step adversarial training, our formulation is based on a single segmentation network, which simplifies adaptation, while improving training quality. Comparison with state-of-the-art adaptation methods reveals considerably better performance of our model on two challenging tasks. Particularly, it consistently yields a performance gain of 1-4% Dice across architectures and datasets. Our results also show robustness to imprecision in the prior knowledge. The versatility of our novel approach can be readily used in various segmentation problems, with code available publicly.

Learning a Target-Dependent Classifier for Cross-Domain Semantic Segmentation: Fine-tuning Versus Meta-Learning

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Joint Semantic Domain Alignment and Target Classifier Learning for Unsupervised Domain Adaptation

Partial Domain Adaptation on Semantic Segmentation

Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentation

When Unsupervised Domain Adaptation Meets Tensor Representations.

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Cross-Domain Scene Unsupervised Learning Segmentation with Dynamic Subdomains

Focus on Your Target: A Dual Teacher-Student Framework for Domain-adaptive Semantic Segmentation

Learning to Adapt to Evolving Domains.

Multi-Target Domain Adaptation with Collaborative Consistency Learning

Contrast, Stylize and Adapt: Unsupervised Contrastive Learning Framework for Domain Adaptive Semantic Segmentation

Constrained Domain Adaptation for Image Segmentation

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Unsupervised Domain Adaptation with Target Reconstruction and Label Confusion in the Common Subspace