Abstract:Although existing unsupervised domain adaptation (UDA) methods have successfully applied to semantic segmentation tasks for high-resolution remote sensing (HRS) images, they still have some limitations that need to be addressed: 1) they mainly focus on aligning the marginal distributions while ignoring the interdomain differences in the conditional distributions, which may be suboptimal because they assume that the boundaries of category decision are identical across domains; and 2) they depend on self-supervised learning for easy-to-hard alignment, which may result in model learning erroneous knowledge from the pseudo labels. To address the above limitations, we propose a joint distribution adaptive-alignment framework (JDAF) to eliminate the distribution difference between the source and target domains, which is mainly composed of a marginal distribution alignment (MDA) module, a conditional distribution alignment (CDA) module, and an improved easy-to-hard adaptation strategy. The MDA module is used to narrow local semantic and global spatial differences between domains and first advance, and then, the CDA module that includes a category-invariant feature alignment (CFA) block and a dataset-level context aggregation (DCA) block is presented and designed, which can dynamically update and align the feature representations that are invariant to category change and adaptively incorporate dataset-level context into the features of source domain to enhance the pixel-level representation. An uncertainty-adaptive learning (UAL) method is, moreover, proposed to improve the easy-to-hard adaptation strategy by enabling the model to learn accurate knowledge from the pseudo labels, which can boost the adaptive performance of the whole JDAF. Comprehensive experiments with four cross-domain tasks on two benchmark datasets of aerospace HRS images demonstrate that the proposed JDAF achieves significant performance gains compared to the state-of-the-art cross-domain semantic segmentation methods. Our code is available at: https://github.com/maple-hx/JDAF.

Structure-Aware Semantic-Aligned Network for Universal Cross-Domain Retrieval

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Semantic Feature Learning for Universal Unsupervised Cross-Domain Retrieval

Universal unsupervised cross-domain 3D shape retrieval

Structured Serialization Semantic Transfer Network for Unsupervised Cross-Domain Recognition and Retrieval

Semantic-Aware Alignment Network for Cross-Resolution Change Detection

Mining Cross-Domain Structure Affinity for Refined Building Segmentation in Weakly Supervised Constraints

SynCDR : Training Cross Domain Retrieval Models with Synthetic Data

A Collaborative Alignment Framework of Transferable Knowledge Extraction for Unsupervised Domain Adaptation

Towards Uncovering the Intrinsic Data Structures for Unsupervised Domain Adaptation using Structurally Regularized Deep Clustering

Category-Level Assignment for Cross-Domain Semantic Segmentation in Remote Sensing Images

Cross-domain Structure Learning for Visual Data Recognition

Cross-Region Domain Adaptation for Class-level Alignment

Visual Contextual Semantic Reasoning for Cross-Modal Drone Image-Text Retrieval

Domain-Specific Alignment Network for Multi-Domain Image-Based 3D Object Retrieval

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Structure-Aware Residual-Center Representation for Self-Supervised Open-Set 3D Cross-Modal Retrieval

DASRSNet: Multitask Domain Adaptation for Super-Resolution-Aided Semantic Segmentation of Remote Sensing Images

Joint Distribution Adaptive-Alignment for Cross-Domain Segmentation of High-Resolution Remote Sensing Images

Consistent Domain Structure Learning and Domain Alignment for 2D Image-Based 3D Objects Retrieval.

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images