Abstract:Although existing unsupervised domain adaptation (UDA) methods have successfully applied to semantic segmentation tasks for high-resolution remote sensing (HRS) images, they still have some limitations that need to be addressed: 1) they mainly focus on aligning the marginal distributions while ignoring the interdomain differences in the conditional distributions, which may be suboptimal because they assume that the boundaries of category decision are identical across domains; and 2) they depend on self-supervised learning for easy-to-hard alignment, which may result in model learning erroneous knowledge from the pseudo labels. To address the above limitations, we propose a joint distribution adaptive-alignment framework (JDAF) to eliminate the distribution difference between the source and target domains, which is mainly composed of a marginal distribution alignment (MDA) module, a conditional distribution alignment (CDA) module, and an improved easy-to-hard adaptation strategy. The MDA module is used to narrow local semantic and global spatial differences between domains and first advance, and then, the CDA module that includes a category-invariant feature alignment (CFA) block and a dataset-level context aggregation (DCA) block is presented and designed, which can dynamically update and align the feature representations that are invariant to category change and adaptively incorporate dataset-level context into the features of source domain to enhance the pixel-level representation. An uncertainty-adaptive learning (UAL) method is, moreover, proposed to improve the easy-to-hard adaptation strategy by enabling the model to learn accurate knowledge from the pseudo labels, which can boost the adaptive performance of the whole JDAF. Comprehensive experiments with four cross-domain tasks on two benchmark datasets of aerospace HRS images demonstrate that the proposed JDAF achieves significant performance gains compared to the state-of-the-art cross-domain semantic segmentation methods. Our code is available at: https://github.com/maple-hx/JDAF.

Shape-aware Joint Distribution Alignment for Cross-domain Image Segmentation

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Joint Distribution Adaptive-Alignment for Cross-Domain Segmentation of High-Resolution Remote Sensing Images

Joint Geometrical and Statistical Alignment for Visual Domain Adaptation

Joint alignment of the distribution in input and feature space for cross-domain aerial image semantic segmentation

Unsupervised Domain Adaptation for Medical Image Segmentation by Selective Entropy Constraints and Adaptive Semantic Alignment

An Unsupervised Domain Adaptation Model Based on Multi-Level Joint Alignment for Multi-Modal Cardiac Image Segmentation

AttENT: Domain-Adaptive Medical Image Segmentation Via Attention-Aware Translation and Adversarial Entropy Minimization

Unsupervised Domain Adaptation with Pseudo Shape Supervision for IC Image Segmentation

A Two-stage Unsupervised Domain Adaptation Method for OCT Image Segmentation

Unsupervised Domain Adaptation Network with Category-Centric Prototype Aligner for Biomedical Image Segmentation

Joint Analysis of Shapes and Images Via Deep Domain Adaptation

Spatial Alignment for Unsupervised Domain Adaptive Single-Stage Object Detection

Unsupervised Domain Adaptation for Semantic Segmentation Via Cross-Region Alignment

Multi-Source Domain Adaptation for Medical Image Segmentation.

Mind the Gap: Alleviating Local Imbalance for Unsupervised Cross-Modality Medical Image Segmentation.

Joint image and feature adaptative attention-aware networks for cross-modality semantic segmentation

A multi-task unsupervised domain adaptation network for medical image segmentation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Cross-Region Domain Adaptation for Class-level Alignment