Abstract:Unsupervised domain adaptation for remote sensing semantic segmentation seeks to adapt a model trained on the labeled source domain to the unlabeled target domain. One of the most promising ways is to translate images from the source domain to the target domain to align the spectral information or imaging mode by the generative adversarial network (GAN). However, source-to-target translation often brings bias in the translated images causing limited performance, as semantic information is not well considered in the translation procedure. To overcome this limitation, we present an innovative semantic-preserved generative adversarial network (SPGAN), designed to mitigate the image translation bias and then leverage the translated images as well as unlabeled target images by class distribution alignment (CDA) module to train a domain adaptive semantic segmentation model. The above two stages are coupled together to form a unified framework called SPGAN-DA. Specifically, we first conduct semantic invariant translation from source to target domain, which is achieved by introducing representation-invariant and semantic-preserved constraints to the GAN model. To further narrow the landscape layout gap between the translated and target images, CDA semantic segmentation is proposed. CDA semantic segmentation consists of two aspects. At the model input level, object discrepancy is eliminated by introducing the ClassMix operation. At the model output level, boundary enhancement is proposed to refine the performance of object boundaries. Extensive experiments on three typical remote sensing cross-domain semantic segmentation benchmarks demonstrate the effectiveness and generality of our proposed method, which competes favorably against existing state-of-the-art methods.

Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization

SIMGAN: Photo-Realistic Semantic Image Manipulation Using Generative Adversarial Networks.

Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image.

Semi-supervised semantic image segmentation using dual discriminator adversarial networks

Self-Ensembling GAN for Cross-Domain Semantic Segmentation

A Novel Framework for Semantic Segmentation with Generative Adversarial Network

Semantic-Aware Domain Generalized Segmentation.

Pixel Level Data Augmentation for Semantic Image Segmentation Using Generative Adversarial Networks.

Generative Semantic Segmentation

Linear Semantics in Generative Adversarial Networks

Local and Global GANs with Semantic-Aware Upsampling for Image Generation

Semantic Invariant Cross-Domain Image Generation with Generative Adversarial Networks

Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation

Semantic Segmentation by Improved Generative Adversarial Networks

Adversarial Pixel-Level Generation of Semantic Images

Learning to Generate Training Datasets for Robust Semantic Segmentation

SPGAN-DA: Semantic-Preserved Generative Adversarial Network for Domain Adaptive Remote Sensing Image Semantic Segmentation

Dual Attention GANs for Semantic Image Synthesis

Segmentation using adversarial image-to-image networks

Dual-Domain Image Synthesis using Segmentation-Guided GAN

Semi-Supervised Semantic Image Segmentation by Deep Diffusion Models and Generative Adversarial Networks