Abstract:<p>Due to its wide applications, remote sensing (RS) image semantic segmentation has attracted increasing research interest in recent years. Benefiting from its hierarchical abstract ability, the deep semantic segmentation network (DSSN) has achieved tremendous success on RS image semantic segmentation and has gradually become the mainstream technology. However, the superior performance of DSSN highly depends on two conditions: (I) massive quantities of labeled training data exist; (II) the testing data seriously resemble the training data. In actual RS applications, it is difficult to fully meet these conditions due to the RS sensor variation and the distinct landscape variation in different geographic locations. To make DSSN fit the actual RS scenario, this paper exploits the cross-domain RS image semantic segmentation task, which means that DSSN is trained on one labeled dataset (i.e., the source domain) but is tested on another varied dataset (i.e., the target domain). In this setting, the performance of DSSN is inevitably very limited due to the data shift between the source and target domains. To reduce the disadvantageous influence of data shift, this paper proposes a novel objective function with multiple weakly-supervised constraints to learn DSSN for cross-domain RS image semantic segmentation. Through carefully examining the characteristics of cross-domain RS image semantic segmentation, multiple weakly-supervised constraints include the weakly-supervised transfer invariant constraint (WTIC), weakly-supervised pseudo-label constraint (WPLC) and weakly-supervised rotation consistency constraint (WRCC). Specifically, DualGAN is recommended to conduct unsupervised style transfer between the source and target domains to carry out WTIC. To make full use of the merits of multiple constraints, this paper presents a dynamic optimization strategy that dynamically adjusts the constraint weights of the objective function during the training process. With full consideration of the characteristics of the cross-domain RS image semantic segmentation task, this paper gives two cross-domain RS image semantic segmentation settings: (I) variation in geographic location and (II) variation in both geographic location and imaging mode. Extensive experiments demonstrate that our proposed method remarkably outperforms the state-of-the-art methods under both of these settings. The collected datasets and evaluation benchmarks have been made publicly available online (<a href="https://github.com/te-shi/MUCSS">https://github.com/te-shi/MUCSS</a>).</p>

Multisource Collaborative Domain Generalization for Cross-Scene Remote Sensing Image Classification

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

MVDC: A Multi-View Domain Confusion Strategy for Cross Domain Change Detection

Cross-Scene Joint Classification of Multisource Data With Multilevel Domain Adaption Network

Multisource Domain Generalization Two-Branch Network for Hyperspectral Image Cross-Domain Classification

Two-Stage Domain Alignment Single-Source Domain Generalization Network for Cross-Scene Hyperspectral Images Classification

Multisource Semisupervised Adversarial Domain Generalization Network for Cross-Scene Sea-Land Clutter Classification

Building Cross-Domain Mapping Chains from Multi-CycleGAN for Hyperspectral Image Classification

Cross-Scene Hyperspectral Image Classification Based on Cycle-Consistent Adversarial Networks.

Cross-domain attention network for hyperspectral image classification

More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification

Learning deep semantic segmentation network under multiple weakly-supervised constraints for cross-domain remote sensing image semantic segmentation

MultiDAN: Unsupervised, Multistage, Multisource and Multitarget Domain Adaptation for Semantic Segmentation of Remote Sensing Images

FDGNet: Frequency Disentanglement and Data Geometry for Domain Generalization in Cross-Scene Hyperspectral Image Classification

Single Domain Generalization Method for Remote Sensing Image Segmentation via Category Consistency on Domain Randomization

Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification

A Multilevel-Guided Curriculum Domain Adaptation Approach to Semantic Segmentation for High-Resolution Remote Sensing Images.

Mind the Gap: Multilevel Unsupervised Domain Adaptation for Cross-Scene Hyperspectral Image Classification

Single-source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification

Spectral–Spatial Adversarial Multidomain Synthesis Network for Cross-Scene Hyperspectral Image Classification

Few-Shot Multispectral-Hyperspectral Image Collaborative Classification With Feature Distribution Enhancement and Subdomain Alignment