Abstract:A prevalent family of fully convolutional networks are capable of learning discriminative representations and producing structural prediction in semantic segmentation tasks. However, such supervised learning methods require a large amount of labeled data and show inability of learning cross-domain invariant representations, giving rise to overfitting performance on the source dataset. Domain adaptation, a transfer learning technique that demonstrates strength on aligning feature distributions, can improve the performance of learning methods by providing inter-domain discrepancy alleviation. Recently introduced output-space based adaptation methods provide significant advances on cross-domain semantic segmentation tasks, however, a lack of consideration for intra-domain divergence of domain discrepancy remains prone to over-adaptation results on the target domain. To address the problem, we first leverage prototypical knowledge on the target domain to relax its hard domain label to a continuous domain space, where pixel-wise domain adaptation is developed upon a soft adversarial loss. The development of prototypical knowledge allows to elaborate specific adaptation strategies on under-aligned regions and well-aligned regions of the target domain. Furthermore, aiming to achieve better adaptation performance, we employ a unilateral discriminator to alleviate implicit uncertainty on prototypical knowledge. At last, we theoretically and experimentally demonstrate that the proposed prototypical knowledge oriented adaptation approach provides effective guidance on distribution alignment and alleviation on over-adaptation. The proposed approach shows competitive performance with state-of-the-art methods on two cross-domain segmentation tasks.

Combining Pixel-Level and Structure-Level Adaptation for Semantic Segmentation

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

A Prototypical Knowledge Oriented Adaptation Framework for Semantic Segmentation

Domain Adaptive Semantic Segmentation Through Structure Enhancement

Semantic Segmentation Via Domain Adaptation with Global Structure Embedding

Unsupervised Pixel-Wise Weighted Adversarial Domain Adaptation

Target-targeted Domain Adaptation for Unsupervised Semantic Segmentation

Unsupervised Domain Adaptation Multi-Level Adversarial Network for Semantic Segmentation Based on Multi-Modal Features

Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation

Affinity Space Adaptation for Semantic Segmentation Across Domains

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation

A Multi-Grained Unsupervised Domain Adaptation Approach for Semantic Segmentation

Domain Adaptative Semantic Segmentation by Fine-Grained Alignment

Multi-Source Domain Adaptation with Collaborative Learning for Semantic Segmentation

Exploring High-Correlation Source Domain Information for Multi-Source Domain Adaptation in Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

Domain Adaptation for Semantic Segmentation of Road Scenes Via Two-Stage Alignment of Traffic Elements

Fully Convolutional Adaptation Networks for Semantic Segmentation

Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation

Class-conditional domain adaptation for semantic segmentation