Abstract:Although semantic segmentation models based on deep neural networks (DNNs) have achieved excellent results, generalizing well from one remote sensing dataset (source domain) to another dataset with different acquisition conditions (target domain) remains a major challenge. Many domain adaptation (DA) approaches have been proposed to address this problem. DA aims to help DNNs learn a generalizable representation space in which source and target domains have similar feature distributions, but most of the existing DA approaches have difficulty in aligning the high-dimensional image representations of two domains directly. In this study, we proposed a model integrating contrastive learning and adversarial learning in a unified framework for aligning two domains in both representation space and spatial layout. Specifically, the model consists of a semantic segmentation network for feature extraction and two branches for DA. The first branch is used for adaptation in representation space directly by a proposed pixelwise contrastive loss, while the second branch is used for adaptation in predicted results to help two domains have similar spatial layouts through a novel but simple entropy-based similarity discriminator. Additionally, a training strategy called category similarity matching sampling was proposed to provide source and target image pairs with similar category composition for each training iteration, which can help the two branches work better. Extensive experiments indicated that the two branches can benefit each other to gain a superior performance and DA pretraining by our methods can achieve impressive results with only a small number of target labeled samples.

A dual-channel network for cross-domain one-shot semantic segmentation via adversarial learning

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Dual Branch Multi-Level Semantic Learning for Few-Shot Segmentation

Pixel Matching Network for Cross-Domain Few-Shot Segmentation

Dual Complementary Prototype Learning for Few-Shot Segmentation

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Towards Semi-supervised Dual-modal Semantic Segmentation

Learning from the Target: Dual Prototype Network for Few Shot Semantic Segmentation

Joint alignment of the distribution in input and feature space for cross-domain aerial image semantic segmentation

Self-training guided disentangled adaptation for cross-domain remote sensing image semantic segmentation

Progressively Dual Prior Guided Few-shot Semantic Segmentation

DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentation

Semi-supervised Semantic Segmentation via Strong-Weak Dual-Branch Network

Dynamic Divide-and-Conquer Adversarial Training for Robust Semantic Segmentation

Cross-Domain Few-Shot Semantic Segmentation via Doubly Matching Transformation

APANet: Adaptive Prototypes Alignment Network for Few-Shot Semantic Segmentation