Abstract:Although existing unsupervised domain adaptation (UDA) methods have successfully applied to semantic segmentation tasks for high-resolution remote sensing (HRS) images, they still have some limitations that need to be addressed: 1) they mainly focus on aligning the marginal distributions while ignoring the interdomain differences in the conditional distributions, which may be suboptimal because they assume that the boundaries of category decision are identical across domains; and 2) they depend on self-supervised learning for easy-to-hard alignment, which may result in model learning erroneous knowledge from the pseudo labels. To address the above limitations, we propose a joint distribution adaptive-alignment framework (JDAF) to eliminate the distribution difference between the source and target domains, which is mainly composed of a marginal distribution alignment (MDA) module, a conditional distribution alignment (CDA) module, and an improved easy-to-hard adaptation strategy. The MDA module is used to narrow local semantic and global spatial differences between domains and first advance, and then, the CDA module that includes a category-invariant feature alignment (CFA) block and a dataset-level context aggregation (DCA) block is presented and designed, which can dynamically update and align the feature representations that are invariant to category change and adaptively incorporate dataset-level context into the features of source domain to enhance the pixel-level representation. An uncertainty-adaptive learning (UAL) method is, moreover, proposed to improve the easy-to-hard adaptation strategy by enabling the model to learn accurate knowledge from the pseudo labels, which can boost the adaptive performance of the whole JDAF. Comprehensive experiments with four cross-domain tasks on two benchmark datasets of aerospace HRS images demonstrate that the proposed JDAF achieves significant performance gains compared to the state-of-the-art cross-domain semantic segmentation methods. Our code is available at: https://github.com/maple-hx/JDAF.

Low-resolution Image Categorization Via Heterogeneous Domain Adaptation

Locality Robust Domain Adaptation for cross-scene hyperspectral image classification

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Joint Distribution Adaptive-Alignment for Cross-Domain Segmentation of High-Resolution Remote Sensing Images

Confident Learning-Based Domain Adaptation for Hyperspectral Image Classification

Categorizing Low-Resolution Aerial Photos by Hessian-Regularized Perceptual Feature Selection

Multiresolution Discriminative Mixup Network for Fine-Grained Visual Categorization.

Learning Category Discriminability for Active Domain Adaptation.

Discriminative Distribution Alignment: A Unified Framework for Heterogeneous Domain Adaptation

Spectral-Spatial Ensemble Low-Rank Domain Adaptation for Hyperspectral Image Classification

Discriminative and Geometry-Aware Unsupervised Domain Adaptation

LR Aerial Photo Categorization by Cross-Resolution Perceptual Knowledge Propagation

Unsupervised Domain Adaptation for Semantic Segmentation of High-resolution Remote Sensing Imagery Driven by Category-Certainty Attention

LR Aerial Imagery Categorization by Transferring Cross-Resolution Perceptual Experiences

Heterogeneous Domain Adaptation Via Incremental Discriminative Knowledge Consistency

Reliable Domain Adaptation With Classifiers Competition For Image Classification

Low Saturation Confidence Distribution-based Test-Time Adaptation for Cross-Domain Remote Sensing Image Classification

Bridging the Web Data and Fine-Grained Visual Recognition Via Alleviating Label Noise and Domain Mismatch

Remote Sensing Image Categorization with Domain Adaptation-Based Convolution Neural Network

Enhanced Subspace Distribution Matching for Fast Visual Domain Adaptation

Domain-Collaborative Contrastive Learning for Hyperspectral Image Classification