Abstract:Domain Adaption tasks have recently attracted substantial attention in computer vision as they improve the transferability of deep network models from a source to a target domain with different characteristics. A large body of state-of-the-art domain-adaptation methods was developed for image classification purposes, which may be inadequate for segmentation tasks. We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions. Such knowledge may take the form of anatomical information, for instance, structure size or shape, which can be known a priori or learned from the source samples via an auxiliary task. Our general formulation imposes inequality constraints on the network predictions of unlabeled or weakly labeled target samples, thereby matching implicitly the prediction statistics of the target and source domains, with permitted uncertainty of prior knowledge. Furthermore, our inequality constraints easily integrate weak annotations of the target data, such as image-level tags. We address the ensuing constrained optimization problem with differentiable penalties, fully suited for conventional stochastic gradient descent approaches. Unlike common two-step adversarial training, our formulation is based on a single segmentation network, which simplifies adaptation, while improving training quality. Comparison with state-of-the-art adaptation methods reveals considerably better performance of our model on two challenging tasks. Particularly, it consistently yields a performance gain of 1-4% Dice across architectures and datasets. Our results also show robustness to imprecision in the prior knowledge. The versatility of our novel approach can be readily used in various segmentation problems, with code available publicly.

Deep Segmentation Domain Adaptation Network with Weighted Boundary Constraint

Unsupervised Pixel-Wise Weighted Adversarial Domain Adaptation

A Prototypical Knowledge Oriented Adaptation Framework for Semantic Segmentation

Constrained Domain Adaptation for Image Segmentation

Segmentation Networks Domain Adaptation A real image ( a ) Without adaptation ( b ) With adaptation Real images without annotations Synthetic images with annotations ... ... ? ?

Domain Adaptative Semantic Segmentation by Fine-Grained Alignment

SSF-DAN: Separated Semantic Feature Based Domain Adaptation Network for Semantic Segmentation

A Novel Multi-Loss-Based Deep Adversarial Network For Handling Challenging Cases In Semi-Supervised Image Semantic Segmentation

Class-conditional domain adaptation for semantic segmentation

Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation

Classification Constrained Discriminator for Domain Adaptive Semantic Segmentation

Unsupervised Adversarial Domain Adaptation Network for Semantic Segmentation

Weakly Supervised Adversarial Domain Adaptation for Semantic Segmentation in Urban Scenes.

Category-Level Adversaries for Semantic Domain Adaptation

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Domain Adaptive Semantic Segmentation Through Structure Enhancement

BAPA-Net: Boundary Adaptation and Prototype Alignment for Cross-domain Semantic Segmentation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Bridge Segmentation Performance Gap Via Evolving Shape Prior.

Unsupervised Domain Adaptation for Semantic Segmentation with Global and Local Consistency

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning