Abstract:Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen image domains. To cope with these limitations, both unsupervised domain adaptation (UDA) with full source supervision but without target supervision and semi-supervised learning (SSL) with partial supervision have been proposed. While such methods are effective at aligning different feature distributions, there is still a need to efficiently exploit unlabeled data to address the performance gap with respect to fully-supervised methods. In this paper we address semi-supervised domain adaptation (SSDA) for semantic segmentation, where a large amount of labeled source data as well as a small amount of labeled target data are available. We propose a novel and effective two-step semi-supervised dual-domain adaptation (SSDDA) approach to address both cross- and intra-domain gaps in semantic segmentation. The proposed framework is comprised of two mixing modules. First, we conduct a cross-domain adaptation via an image-level mixing strategy, which learns to align the distribution shift of features between the source data and target data. Second, intra-domain adaptation is achieved using a separate student-teacher network which is built to generate category-level data augmentation by mixing unlabeled target data in a way that respects predicted object boundaries. We demonstrate that the proposed approach outperforms state-of-the-art methods on two common synthetic-to-real semantic segmentation benchmarks. An extensive ablation study is provided to further validate the effectiveness of our approach.

Unsupervised Domain Adaptation by Optical Flow Augmentation in Semantic Segmentation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Learning By Analogy: Reliable Supervision From Transformations For Unsupervised Optical Flow Estimation

Noise Transfer for Unsupervised Domain Adaptation of Retinal OCT Images

Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Survey

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Unsupervised Domain Adaptation in Semantic Segmentation: A Review

Source-Free Domain Adaptation for Semantic Segmentation

Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimation

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Adaptation in Semantic Segmentation

Augmentation-based Domain Generalization for Semantic Segmentation

An Unsupervised Domain Adaption Framework for Aerial Image Semantic Segmentation Based on Curriculum Learning

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Semi-supervised Domain Adaptation for Semantic Segmentation

FogAdapt: Self-Supervised Domain Adaptation for Semantic Segmentation of Foggy Images

Partial Domain Adaptation on Semantic Segmentation

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation

Pseudo Features Guided Self-training for Domain Adaptive Semantic Segmentation of Satellite Images

Optical Flow boosts Unsupervised Localization and Segmentation