Abstract:Unsupervised domain adaptation (UDA) aims at adapting a model from the source domain to the target domain by tackling the issue of domain shift. Cross-domain segmentation of remote sensing images (RSIs) remains a big challenge due to the unique properties of RSIs. On the one hand, the divergence of data distribution in different local regions leads to negative transfer by directly applying the global alignment method in RSIs. On the other hand, the underlying category-level structure in the target domain is often ignored, which confuses the decision of semantic boundaries on the dispersed category features caused by large intraclass variance and small interclass variance in RSIs. In this study, we propose a novel fine-grained adaptation framework combining two stages of global-local alignment and category-level alignment to solve the above-mentioned problems. In the first stage of global-local adaptation, an attention map is derived from an intermediate discriminator and focuses on hard-to-align regions to mitigate negative transfer due to global adversarial learning. In the second stage of category-level adaptation, the category feature compact module is utilized to address the issue of dispersed features in the target domain attained by the cross-domain network, which will facilitate the fine-grained alignment of categories. Experiments under various scenarios, including geographic location variation and spectral band composition variation, demonstrate that the local adaptation and category-level adaptation of RSIs are complementary in the cross-domain segmentation, and the integrated framework helps achieve outstanding performance for UDA semantic segmentation of RSIs.

Domain Adaptative Semantic Segmentation by Fine-Grained Alignment

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Unsupervised Domain Adaptive Image Semantic Segmentation Based on Convolutional Fine-Grained Discriminant and Entropy Minimization

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Domain Adaptation for Semantic Segmentation of Road Scenes Via Two-Stage Alignment of Traffic Elements

SSF-DAN: Separated Semantic Feature Based Domain Adaptation Network for Semantic Segmentation

Class-conditional domain adaptation for semantic segmentation

Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimation

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation

Feature Re-Representation and Reliable Pseudo Label Retraining for Cross-Domain Semantic Segmentation.

Unsupervised domain adaptive segmentation algorithm based on two-level category alignment

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Affinity Space Adaptation for Semantic Segmentation Across Domains

Classification Constrained Discriminator for Domain Adaptive Semantic Segmentation

Domain-Adaptive Semantic Segmentation Emerges From Vision-Language Supervised Domain-Debiased Self-Training.

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images