Abstract:Domain adaptation (DA) addresses the challenge of distribution discrepancy between the training and test data, while multi-source domain adaptation (MSDA) is particularly appealing for realistic scenarios. With the emergence of extensive unlabeled datasets, self-supervised learning has gained significant popularity in deep learning. It is noteworthy that multi-source domain adaptation and self-supervised learning share a common objective: leveraging unlabeled data to acquire more informative representations. However, conventional self-supervised learning encounters two main limitations. Firstly, the traditional pretext task falls to transfer fine-grained knowledge to downstream task with general representation learning. Secondly, the scheme of the same feature extractor with distinct prediction heads makes the cross-task knowledge exchange and information sharing ineffective. In order to tackle these challenges, we introduce a novel approach called Domain-Aware Graph Network (DAGNet). DAGNet utilizes a graph neural network as a bridge to facilitate efficient cross-task knowledge exchange. By employing a mask token strategy, we enhance the robustness of representations by selectively masking certain domain or self-supervised information. In terms of datasets, the uneven and style-based domain shifts in current datasets make it challenging to measure the model's domain adaptation performance in real-world applications. To address this issue, we introduce a benchmark dataset DomainVerse with continuous spatio-temporal domain shifts encountered in the real world. Our extensive experiments demonstrate that DAGNet achieves state-of-the-art performance not only on mainstream multi-source domain adaptation datasets but also on different settings within DomainVerse. Code is available at https://github.com/a791702141/SSG.

Self-Adaptive Imbalanced Domain Adaptation With Deep Sparse Autoencoder

Transfer Learning and Deep Domain Adaptation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

A Framework for Self-Supervised Federated Domain Adaptation

Deep Asymmetric Transfer Network For Unbalanced Domain Adaptation

Self-adaptive Re-weighted Adversarial Domain Adaptation

Source-Free Unsupervised Domain Adaptation in Imbalanced Datasets

Representation learning via an integrated autoencoder for unsupervised domain adaptation

Unsupervised Domain Adaptation with Target Reconstruction and Label Confusion in the Common Subspace

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Learning Distinctive Margin Toward Active Domain Adaptation

A source free domain adaptation model based on adversarial learning for image classification

Self-Domain Adaptation for Face Anti-Spoofing

Active Dynamic Weighting for multi-domain adaptation

Deep Model Based Domain Adaptation for Fault Diagnosis.

Deep ladder reconstruction-classification network for unsupervised domain adaptation

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

Cross-domain Self-supervised Learning for Domain Adaptation with Few Source Labels

Domain-Aware Graph Network for Bridging Multi-Source Domain Adaptation

Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey