Abstract:Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen image domains. To cope with these limitations, both unsupervised domain adaptation (UDA) with full source supervision but without target supervision and semi-supervised learning (SSL) with partial supervision have been proposed. While such methods are effective at aligning different feature distributions, there is still a need to efficiently exploit unlabeled data to address the performance gap with respect to fully-supervised methods. In this paper we address semi-supervised domain adaptation (SSDA) for semantic segmentation, where a large amount of labeled source data as well as a small amount of labeled target data are available. We propose a novel and effective two-step semi-supervised dual-domain adaptation (SSDDA) approach to address both cross- and intra-domain gaps in semantic segmentation. The proposed framework is comprised of two mixing modules. First, we conduct a cross-domain adaptation via an image-level mixing strategy, which learns to align the distribution shift of features between the source data and target data. Second, intra-domain adaptation is achieved using a separate student-teacher network which is built to generate category-level data augmentation by mixing unlabeled target data in a way that respects predicted object boundaries. We demonstrate that the proposed approach outperforms state-of-the-art methods on two common synthetic-to-real semantic segmentation benchmarks. An extensive ablation study is provided to further validate the effectiveness of our approach.

Semi-supervised adversarial discriminative domain adaptation

Semi-supervised Domain Adaptation for Semantic Segmentation

Attention-based Adversarial Partial Domain Adaptation

Semi-Supervised Domain Adaptation Via Convolutional Neural Network

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Effective Visual Domain Adaptation via Generative Adversarial Distribution Matching

Fully semisupervised framework for visual domain adaptation.

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

Semi-supervised semantic image segmentation using dual discriminator adversarial networks

Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation

Semi-Supervised Domain Adaptation via Adaptive and Progressive Feature Alignment

Dual Dynamic Consistency Regularization for Semi-Supervised Domain Adaptation

Generate To Adapt: Aligning Domains using Generative Adversarial Networks

Partial Domain Adaptation on Semantic Segmentation

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.

Adversarial Domain Adaptation with Semantic Consistency for Cross-Domain Image Classification

Semi-Supervised Domain Generalization for Object Detection via Language-Guided Feature Alignment

Unsupervised Domain Adaptive Image Semantic Segmentation Based on Convolutional Fine-Grained Discriminant and Entropy Minimization

Unsupervised Urban Scene Segmentation Via Domain Adaptation

Semi-Supervised Learning with Flexible Discriminator Objective in Generative Adversarial Networks Framework

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation