Abstract:When segmenting massive amounts of remote sensing images collected from different satellites or geographic locations (cities), the pre-trained deep learning models cannot always output satisfactory predictions. To deal with this issue, domain adaptation has been widely utilized to enhance the generalization abilities of the segmentation models. Most of the existing domain adaptation methods, which based on image-to-image translation, firstly transfer the source images to the pseudo-target images, adapt the classifier from the source domain to the target domain. However, these unidirectional methods suffer from the following two limitations: (1) they do not consider the inverse procedure and they cannot fully take advantage of the information from the other domain, which is also beneficial, as confirmed by our experiments; (2) these methods may fail in the cases where transferring the source images to the pseudo-target images is difficult. In this paper, in order to solve these problems, we propose a novel framework BiFDANet for unsupervised bidirectional domain adaptation in the semantic segmentation of remote sensing images. It optimizes the segmentation models in two opposite directions. In the source-to-target direction, BiFDANet learns to transfer the source images to the pseudo-target images and adapts the classifier to the target domain. In the opposite direction, BiFDANet transfers the target images to the pseudo-source images and optimizes the source classifier. At test stage, we make the best of the source classifier and the target classifier, which complement each other with a simple linear combination method, further improving the performance of our BiFDANet. Furthermore, we propose a new bidirectional semantic consistency loss for our BiFDANet to maintain the semantic consistency during the bidirectional image-to-image translation process. The experiments on two datasets including satellite images and aerial images demonstrate the superiority of our method against existing unidirectional methods.

BRG: Bidirectional Regularization Guidance for Unsupervised Domain Adaptation Semantic Segmentation

A New Bidirectional Unsupervised Domain Adaptation Segmentation Framework

Uncertainty-Aware Consistency Regularization for Cross-Domain Semantic Segmentation

Unsupervised Domain Adaptation Augmented by Mutually Boosted Attention for Semantic Segmentation of VHR Remote Sensing Images

Domain Adaptive Semantic Segmentation Via Regional Contrastive Consistency Regularization

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Category Anchor-Guided Unsupervised Domain Adaptation for Semantic Segmentation

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images

Hard-aware Instance Adaptive Self-training for Unsupervised Cross-domain Semantic Segmentation

A Multilevel-Guided Curriculum Domain Adaptation Approach to Semantic Segmentation for High-Resolution Remote Sensing Images.

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Self-training and Multi-level Adversarial Network for Domain Adaptive Remote Sensing Image Segmentation

BEV-DG: Cross-Modal Learning under Bird's-Eye View for Domain Generalization of 3D Semantic Segmentation

Unsupervised Domain Adaptation for Semantic Segmentation Via Cross-Region Alignment

Regularizing Self-training for Unsupervised Domain Adaptation via Structural Constraints

Enhancing Unsupervised Domain Adaptation by Discriminative Relevance Regularization

Instance Adaptive Self-training for Unsupervised Domain Adaptation

Focus on Your Target: A Dual Teacher-Student Framework for Domain-adaptive Semantic Segmentation

Confidence-and-Refinement Adaptation Model for Cross-Domain Semantic Segmentation

S&GDA: An Unsupervised Domain Adaptive Semantic Segmentation Framework Considering Both Imaging Scene and Geometric Domain Shifts

BiFDANet: Unsupervised Bidirectional Domain Adaptation for Semantic Segmentation of Remote Sensing Images