Abstract:Conventional machine learning algorithms suffer the problem that the model trained on existing data fails to generalize well to the data sampled from other distributions. To tackle this issue, unsupervised domain adaptation (UDA) transfers the knowledge learned from a well-labeled source domain to a different but related target domain where labeled data is unavailable. The majority of existing UDA methods assume that data from the source domain and the target domain are available and complete during training. Thus, the divergence between the two domains can be formulated and minimized. In this paper, we consider a more practical yet challenging UDA setting where either the source domain data or the target domain data are unknown. Conventional UDA methods would fail this setting since the domain divergence is agnostic due to the absence of the source data or the target data. Technically, we investigate UDA from a novel view—adversarial attack—and tackle the divergence-agnostic adaptive learning problem in a unified framework. Specifically, we first report the motivation of our approach by investigating the inherent relationship between UDA and adversarial attacks. Then we elaborately design adversarial examples to attack the training model and harness these adversarial examples. We argue that the generalization ability of the model would be significantly improved if it can defend against our attack, so as to improve the performance on the target domain. Theoretically, we analyze the generalization bound for our method based on domain adaptation theories. Extensive experimental results on multiple UDA benchmarks under conventional, source-absent and target-absent UDA settings verify that our method is able to achieve a favorable performance compared with previous ones. Notably, this work extends the scope of both domain adaptation and adversarial attack, and expected to inspire more ideas in the community.

Adversarial Divergence Training for Universal Cross-Scene Classification.

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

Dual Contrastive Universal Adaptation Network.

Uni3DA: Universal 3D Domain Adaptation for Object Recognition

HyUniDA: Breaking Label Set Constraints for Universal Domain Adaptation in Cross-Scene Hyperspectral Image Classification

Two-Stage Domain Alignment Single-Source Domain Generalization Network for Cross-Scene Hyperspectral Images Classification

Cross-Scene Joint Classification of Multisource Data With Multilevel Domain Adaption Network

Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification

Self-training and Multi-level Adversarial Network for Domain Adaptive Remote Sensing Image Segmentation

C3DA: A Universal Domain Adaptation Method for Scene Classification From Remote Sensing Imagery

Noisy Universal Domain Adaptation via Divergence Optimization for Visual Recognition

Domain Consensus Clustering for Universal Domain Adaptation

Universal Domain Adaptation for Hyperspectral Image Classification

Divergence-agnostic Unsupervised Domain Adaptation by Adversarial Attacks

Online Unsupervised Domain Adaptation Via Reducing Inter- and Intra-Domain Discrepancies

Adversarial pair-wise distribution matching for remote sensing image cross-scene classification

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

Cross-Region Domain Adaptation for Class-level Alignment

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Universal multi-Source domain adaptation for image classification

A Two-Stage Adaptation Network (TSAN) for Remote Sensing Scene Classification in Single-Source-Mixed-Multiple-Target Domain Adaptation (S<SUP>2</SUP>M<SUP>2</SUP>T DA) Scenarios