Abstract:Domain adaptation (DA) addresses the challenge of distribution discrepancy between the training and test data, while multi-source domain adaptation (MSDA) is particularly appealing for realistic scenarios. With the emergence of extensive unlabeled datasets, self-supervised learning has gained significant popularity in deep learning. It is noteworthy that multi-source domain adaptation and self-supervised learning share a common objective: leveraging unlabeled data to acquire more informative representations. However, conventional self-supervised learning encounters two main limitations. Firstly, the traditional pretext task falls to transfer fine-grained knowledge to downstream task with general representation learning. Secondly, the scheme of the same feature extractor with distinct prediction heads makes the cross-task knowledge exchange and information sharing ineffective. In order to tackle these challenges, we introduce a novel approach called Domain-Aware Graph Network (DAGNet). DAGNet utilizes a graph neural network as a bridge to facilitate efficient cross-task knowledge exchange. By employing a mask token strategy, we enhance the robustness of representations by selectively masking certain domain or self-supervised information. In terms of datasets, the uneven and style-based domain shifts in current datasets make it challenging to measure the model's domain adaptation performance in real-world applications. To address this issue, we introduce a benchmark dataset DomainVerse with continuous spatio-temporal domain shifts encountered in the real world. Our extensive experiments demonstrate that DAGNet achieves state-of-the-art performance not only on mainstream multi-source domain adaptation datasets but also on different settings within DomainVerse. Code is available at https://github.com/a791702141/SSG.

Multi-Source Domain Adaptation and Semi-Supervised Domain Adaptation with Focus on Visual Domain Adaptation Challenge 2019

VisDA: The Visual Domain Adaptation Challenge

A Review of Single-Source Deep Unsupervised Visual Domain Adaptation

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Mdalu: Multi-Source Domain Adaptation and Label Unification with Partial Datasets

Fully semisupervised framework for visual domain adaptation.

Enhancing Multi-Source Open-Set Domain Adaptation through Nearest Neighbor Classification with Self-Supervised Vision Transformer

Multi-source Domain Adaptation for Semantic Segmentation

Gotta Adapt 'Em All: Joint Pixel and Feature-Level Domain Adaptation for Recognition in the Wild

Multi-Source Domain Adaptation with Collaborative Learning for Semantic Segmentation

Semi-supervised Domain Adaptation with Subspace Learning for Visual Recognition

Label Propagation with Multi-Stage Inference for Visual Domain Adaptation.

Enhancing Visual Domain Adaptation with Source Preparation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Multiple-source Domain Adaptation with Generative Adversarial Nets

Domain-Aware Graph Network for Bridging Multi-Source Domain Adaptation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Adaptation in Semantic Segmentation

VisDA-2021 Competition Universal Domain Adaptation to Improve Performance on Out-of-Distribution Data

Multi-source Distilling Domain Adaptation

Semi-supervised Domain Adaptation for Semantic Segmentation

Dual Path Learning for Domain Adaptation of Semantic Segmentation.