Abstract:Conventional machine learning algorithms suffer the problem that the model trained on existing data fails to generalize well to the data sampled from other distributions. To tackle this issue, unsupervised domain adaptation (UDA) transfers the knowledge learned from a well-labeled source domain to a different but related target domain where labeled data is unavailable. The majority of existing UDA methods assume that data from the source domain and the target domain are available and complete during training. Thus, the divergence between the two domains can be formulated and minimized. In this paper, we consider a more practical yet challenging UDA setting where either the source domain data or the target domain data are unknown. Conventional UDA methods would fail this setting since the domain divergence is agnostic due to the absence of the source data or the target data. Technically, we investigate UDA from a novel view—adversarial attack—and tackle the divergence-agnostic adaptive learning problem in a unified framework. Specifically, we first report the motivation of our approach by investigating the inherent relationship between UDA and adversarial attacks. Then we elaborately design adversarial examples to attack the training model and harness these adversarial examples. We argue that the generalization ability of the model would be significantly improved if it can defend against our attack, so as to improve the performance on the target domain. Theoretically, we analyze the generalization bound for our method based on domain adaptation theories. Extensive experimental results on multiple UDA benchmarks under conventional, source-absent and target-absent UDA settings verify that our method is able to achieve a favorable performance compared with previous ones. Notably, this work extends the scope of both domain adaptation and adversarial attack, and expected to inspire more ideas in the community.

Improving Robustness of Unsupervised Domain Adaptation with Adversarial Networks

Exploring Adversarially Robust Training for Unsupervised Domain Adaptation

Certifying Better Robust Generalization for Unsupervised Domain Adaptation

On the Robustness of Domain Adaption to Adversarial Attacks

Adversarially Robust Source-free Domain Adaptation with Relaxed Adversarial Training.

Divergence-agnostic Unsupervised Domain Adaptation by Adversarial Attacks

Improving the Generalization of Adversarial Training with Domain Adaptation

An adversarial defense algorithm based on robust U-net

Feature Augmentation for Adversarial Robustness

SRoUDA: Meta Self-training for Robust Unsupervised Domain Adaptation

Re-weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation

Adversarial Unsupervised Domain Adaptation Via Real Data Augmentation and Uncertainty Penalization

Enhancing Adversarial Robustness Via Anomaly-aware Adversarial Training.

Provable Unrestricted Adversarial Training without Compromise with Generalizability

Unsupervised Domain Adaptation with Adversarial Distribution Adaptation Network.

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domain

Towards Trustworthy Unsupervised Domain Adaptation: A Representation Learning Perspective for Enhancing Robustness, Discrimination, and Generalization

Learning Universal Adversarial Perturbation by Adversarial Example

AT-GAN: An Adversarial Generator Model for Non-constrained Adversarial Examples