Abstract:<p>Due to its wide applications, remote sensing (RS) image semantic segmentation has attracted increasing research interest in recent years. Benefiting from its hierarchical abstract ability, the deep semantic segmentation network (DSSN) has achieved tremendous success on RS image semantic segmentation and has gradually become the mainstream technology. However, the superior performance of DSSN highly depends on two conditions: (I) massive quantities of labeled training data exist; (II) the testing data seriously resemble the training data. In actual RS applications, it is difficult to fully meet these conditions due to the RS sensor variation and the distinct landscape variation in different geographic locations. To make DSSN fit the actual RS scenario, this paper exploits the cross-domain RS image semantic segmentation task, which means that DSSN is trained on one labeled dataset (i.e., the source domain) but is tested on another varied dataset (i.e., the target domain). In this setting, the performance of DSSN is inevitably very limited due to the data shift between the source and target domains. To reduce the disadvantageous influence of data shift, this paper proposes a novel objective function with multiple weakly-supervised constraints to learn DSSN for cross-domain RS image semantic segmentation. Through carefully examining the characteristics of cross-domain RS image semantic segmentation, multiple weakly-supervised constraints include the weakly-supervised transfer invariant constraint (WTIC), weakly-supervised pseudo-label constraint (WPLC) and weakly-supervised rotation consistency constraint (WRCC). Specifically, DualGAN is recommended to conduct unsupervised style transfer between the source and target domains to carry out WTIC. To make full use of the merits of multiple constraints, this paper presents a dynamic optimization strategy that dynamically adjusts the constraint weights of the objective function during the training process. With full consideration of the characteristics of the cross-domain RS image semantic segmentation task, this paper gives two cross-domain RS image semantic segmentation settings: (I) variation in geographic location and (II) variation in both geographic location and imaging mode. Extensive experiments demonstrate that our proposed method remarkably outperforms the state-of-the-art methods under both of these settings. The collected datasets and evaluation benchmarks have been made publicly available online (<a href="https://github.com/te-shi/MUCSS">https://github.com/te-shi/MUCSS</a>).</p>

Semantic Annotation of Satellite Images Via Joint Multi-Feature Learning with Diversity Constraint.

Semantic Image Retrieval Based on Multiple-Instance Learning

Semantic Annotation of High-Resolution Satellite Images Via Weakly Supervised Learning.

Multi-modal Feature Fusion for Geographic Image Annotation.

Towards Multi-Semantic Image Annotation with Graph Regularized Exclusive Group Lasso

Reconciling Semantic Controllability and Diversity for Remote Sensing Image Synthesis with Hybrid Semantic Embedding

DiverseNet: Decision Diversified Semi-supervised Semantic Segmentation Networks for Remote Sensing Imagery

Semantic Stereo for Incidental Satellite Images

Multi-source collaborative enhanced for remote sensing images semantic segmentation

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images

Assisted learning for land use classification: The important role of semantic correlation between heterogeneous images

Joint Semantic Segmentation using representations of LiDAR point clouds and camera images

Satellite Video Multi-Label Scene Classification With Spatial and Temporal Feature Cooperative Encoding: A Benchmark Dataset and Method

Semantic Segmentation of Weakly Annotated Remote Sensing Images Based on Feature Adversary and Uncertainty Perception

Multi-view Subspace Learning with Diversity Enforced Skeleton Embedding.

Active Learning for Improved Semi-Supervised Semantic Segmentation in Satellite Images

Category-sensitive Semi-Supervised Semantic Segmentation Framework for Land-Use/land-cover Mapping with Optical Remote Sensing Images

Robust 3D Semantic Segmentation Method Based on Multi-Modal Collaborative Learning

Research on semantic segmentation algorithm of multispectral remote sensing image based on deep learning

Learning deep semantic segmentation network under multiple weakly-supervised constraints for cross-domain remote sensing image semantic segmentation

Dual attention deep fusion semantic segmentation networks of large-scale satellite remote-sensing images