Abstract:Although existing unsupervised domain adaptation (UDA) methods have successfully applied to semantic segmentation tasks for high-resolution remote sensing (HRS) images, they still have some limitations that need to be addressed: 1) they mainly focus on aligning the marginal distributions while ignoring the interdomain differences in the conditional distributions, which may be suboptimal because they assume that the boundaries of category decision are identical across domains; and 2) they depend on self-supervised learning for easy-to-hard alignment, which may result in model learning erroneous knowledge from the pseudo labels. To address the above limitations, we propose a joint distribution adaptive-alignment framework (JDAF) to eliminate the distribution difference between the source and target domains, which is mainly composed of a marginal distribution alignment (MDA) module, a conditional distribution alignment (CDA) module, and an improved easy-to-hard adaptation strategy. The MDA module is used to narrow local semantic and global spatial differences between domains and first advance, and then, the CDA module that includes a category-invariant feature alignment (CFA) block and a dataset-level context aggregation (DCA) block is presented and designed, which can dynamically update and align the feature representations that are invariant to category change and adaptively incorporate dataset-level context into the features of source domain to enhance the pixel-level representation. An uncertainty-adaptive learning (UAL) method is, moreover, proposed to improve the easy-to-hard adaptation strategy by enabling the model to learn accurate knowledge from the pseudo labels, which can boost the adaptive performance of the whole JDAF. Comprehensive experiments with four cross-domain tasks on two benchmark datasets of aerospace HRS images demonstrate that the proposed JDAF achieves significant performance gains compared to the state-of-the-art cross-domain semantic segmentation methods. Our code is available at: https://github.com/maple-hx/JDAF.

CAFA: Cross-Modal Attentive Feature Alignment for Cross-Domain Urban Scene Segmentation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Confidence-and-Refinement Adaptation Model for Cross-Domain Semantic Segmentation

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentation

Cross-Domain Semantic Segmentation of Urban Scenes Via Multi-Level Feature Alignment.

Deep Covariance Alignment for Domain Adaptive Remote Sensing Image Segmentation

Preserving Label-Related Domain-Specific Information for Cross-Domain Semantic Segmentation

Multi-Modal Unsupervised Domain Adaptation for Semantic Image Segmentation

Cross-Region Domain Adaptation for Class-level Alignment

Multi-Scale Depth-Aware Unsupervised Domain Adaption in Semantic Segmentation.

More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation

Unsupervised Domain Adaptation for Semantic Segmentation Via Cross-Region Alignment

Joint alignment of the distribution in input and feature space for cross-domain aerial image semantic segmentation

Joint Distribution Adaptive-Alignment for Cross-Domain Segmentation of High-Resolution Remote Sensing Images

Cross-Modality Domain Adaptation for Freespace Detection: A Simple Yet Effective Baseline

Category Anchor-Guided Unsupervised Domain Adaptation for Semantic Segmentation

Fully Convolutional Adaptation Networks for Semantic Segmentation

Unsupervised domain adaptation via coarse-to-fine feature alignment method using contrastive learning

Alleviating Semantic-level Shift: A Semi-supervised Domain Adaptation Method for Semantic Segmentation