Abstract:When segmenting massive amounts of remote sensing images collected from different satellites or geographic locations (cities), the pre-trained deep learning models cannot always output satisfactory predictions. To deal with this issue, domain adaptation has been widely utilized to enhance the generalization abilities of the segmentation models. Most of the existing domain adaptation methods, which based on image-to-image translation, firstly transfer the source images to the pseudo-target images, adapt the classifier from the source domain to the target domain. However, these unidirectional methods suffer from the following two limitations: (1) they do not consider the inverse procedure and they cannot fully take advantage of the information from the other domain, which is also beneficial, as confirmed by our experiments; (2) these methods may fail in the cases where transferring the source images to the pseudo-target images is difficult. In this paper, in order to solve these problems, we propose a novel framework BiFDANet for unsupervised bidirectional domain adaptation in the semantic segmentation of remote sensing images. It optimizes the segmentation models in two opposite directions. In the source-to-target direction, BiFDANet learns to transfer the source images to the pseudo-target images and adapts the classifier to the target domain. In the opposite direction, BiFDANet transfers the target images to the pseudo-source images and optimizes the source classifier. At test stage, we make the best of the source classifier and the target classifier, which complement each other with a simple linear combination method, further improving the performance of our BiFDANet. Furthermore, we propose a new bidirectional semantic consistency loss for our BiFDANet to maintain the semantic consistency during the bidirectional image-to-image translation process. The experiments on two datasets including satellite images and aerial images demonstrate the superiority of our method against existing unidirectional methods.

Bidirectional Adversarial Domain Adaptation with Semantic Consistency.

A New Bidirectional Unsupervised Domain Adaptation Segmentation Framework

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Semantic Concentration for Domain Adaptation

Semi-Supervised Domain Adaptation via Adaptive and Progressive Feature Alignment

Bidirectional Learning for Domain Adaptation of Semantic Segmentation

Adversarial Domain Adaptation with Semantic Consistency for Cross-Domain Image Classification

BiFDANet: Unsupervised Bidirectional Domain Adaptation for Semantic Segmentation of Remote Sensing Images

Semi-supervised Domain Adaptation for Semantic Segmentation

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Adaptation in Semantic Segmentation

Affinity Space Adaptation for Semantic Segmentation Across Domains

Heterogeneous domain adaptation by semantic distribution alignment network

Photosensitivity of 10-substituted visual pigment analogues: detection of a specific secondary opsin-retinal interaction.

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

Self-adaptive Re-weighted Adversarial Domain Adaptation

Unsupervised Domain Adaptation for Semantic Segmentation via Low-level Edge Information Transfer

Domain-Augmented Domain Adaptation

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.