Abstract:Domain Adaption tasks have recently attracted substantial attention in computer vision as they improve the transferability of deep network models from a source to a target domain with different characteristics. A large body of state-of-the-art domain-adaptation methods was developed for image classification purposes, which may be inadequate for segmentation tasks. We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions. Such knowledge may take the form of anatomical information, for instance, structure size or shape, which can be known a priori or learned from the source samples via an auxiliary task. Our general formulation imposes inequality constraints on the network predictions of unlabeled or weakly labeled target samples, thereby matching implicitly the prediction statistics of the target and source domains, with permitted uncertainty of prior knowledge. Furthermore, our inequality constraints easily integrate weak annotations of the target data, such as image-level tags. We address the ensuing constrained optimization problem with differentiable penalties, fully suited for conventional stochastic gradient descent approaches. Unlike common two-step adversarial training, our formulation is based on a single segmentation network, which simplifies adaptation, while improving training quality. Comparison with state-of-the-art adaptation methods reveals considerably better performance of our model on two challenging tasks. Particularly, it consistently yields a performance gain of 1-4% Dice across architectures and datasets. Our results also show robustness to imprecision in the prior knowledge. The versatility of our novel approach can be readily used in various segmentation problems, with code available publicly.

Constrained Domain Adaptation for Image Segmentation

A Prototypical Knowledge Oriented Adaptation Framework for Semantic Segmentation

Unsupervised Pixel-Wise Weighted Adversarial Domain Adaptation

Learning a Target-Dependent Classifier for Cross-Domain Semantic Segmentation: Fine-tuning Versus Meta-Learning

Segmentation Networks Domain Adaptation A real image ( a ) Without adaptation ( b ) With adaptation Real images without annotations Synthetic images with annotations ... ... ? ?

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

Deep Segmentation Domain Adaptation Network with Weighted Boundary Constraint

Unsupervised Domain Adaptation for Medical Image Segmentation by Selective Entropy Constraints and Adaptive Semantic Alignment

Classification Constrained Discriminator for Domain Adaptive Semantic Segmentation

Knowledge Based Domain Adaptation for Semantic Segmentation.

Learning Instance-Specific Adaptation for Cross-Domain Segmentation

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation.

Bridge Segmentation Performance Gap Via Evolving Shape Prior.

Edge-preserving Domain Adaptation for semantic segmentation of Medical Images

Target-targeted Domain Adaptation for Unsupervised Semantic Segmentation

Probabilistic Domain Adaptation for Biomedical Image Segmentation

Class-conditional domain adaptation for semantic segmentation

Bidirectional Learning for Domain Adaptation of Semantic Segmentation