Abstract:Conventional machine learning algorithms suffer the problem that the model trained on existing data fails to generalize well to the data sampled from other distributions. To tackle this issue, unsupervised domain adaptation (UDA) transfers the knowledge learned from a well-labeled source domain to a different but related target domain where labeled data is unavailable. The majority of existing UDA methods assume that data from the source domain and the target domain are available and complete during training. Thus, the divergence between the two domains can be formulated and minimized. In this paper, we consider a more practical yet challenging UDA setting where either the source domain data or the target domain data are unknown. Conventional UDA methods would fail this setting since the domain divergence is agnostic due to the absence of the source data or the target data. Technically, we investigate UDA from a novel view—adversarial attack—and tackle the divergence-agnostic adaptive learning problem in a unified framework. Specifically, we first report the motivation of our approach by investigating the inherent relationship between UDA and adversarial attacks. Then we elaborately design adversarial examples to attack the training model and harness these adversarial examples. We argue that the generalization ability of the model would be significantly improved if it can defend against our attack, so as to improve the performance on the target domain. Theoretically, we analyze the generalization bound for our method based on domain adaptation theories. Extensive experimental results on multiple UDA benchmarks under conventional, source-absent and target-absent UDA settings verify that our method is able to achieve a favorable performance compared with previous ones. Notably, this work extends the scope of both domain adaptation and adversarial attack, and expected to inspire more ideas in the community.

Progressive Decision Boundary Shifting for Unsupervised Domain Adaptation

A New Bidirectional Unsupervised Domain Adaptation Segmentation Framework

Boosting Unsupervised Domain Adaptation with Soft Pseudo-label and Curriculum Learning

Reliable Domain Adaptation With Classifiers Competition

Progressive Feature Alignment for Unsupervised Domain Adaptation

Classifier Decoupled Training for Black-Box Unsupervised Domain Adaptation.

Towards Adaptive Multi-Scale Intermediate Domain Via Progressive Training for Unsupervised Domain Adaptation

Reliable Domain Adaptation With Classifiers Competition For Image Classification

Dynamic bias alignment and discrimination enhancement for unsupervised domain adaptation

Online Unsupervised Domain Adaptation Via Reducing Inter- and Intra-Domain Discrepancies

Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation

Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection

Unsupervised Domain Adaptation with Progressive Adaptation of Subspaces

Upcycling Models under Domain and Category Shift

Balancing Transferability and Discriminability for Unsupervised Domain Adaptation.

Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iterate

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Divergence-agnostic Unsupervised Domain Adaptation by Adversarial Attacks

Class Discriminative Adversarial Learning for Unsupervised Domain Adaptation

Enhanced Unsupervised Domain Adaptation with Dual-Attention Between Classification and Domain Alignment.

Learning Target Domain Specific Classifier for Partial Domain Adaptation