Abstract:Deep neural networks suffer from performance decay when there is domain shift between the labeled source domain and unlabeled target domain, which motivates the research on domain adaptation (DA). Conventional DA methods usually assume that the labeled data is sampled from a single source distribution. However, in practice, labeled data may be collected from multiple sources, while naive application of the single-source DA algorithms may lead to suboptimal solutions. In this paper, we propose a novel multi-source distilling domain adaptation (MDDA) network, which not only considers the different distances among multiple sources and the target, but also investigates the different similarities of the source samples to the target ones. Specifically, the proposed MDDA includes four stages: (1) pre-train the source classifiers separately using the training data from each source; (2) adversarially map the target into the feature space of each source respectively by minimizing the empirical Wasserstein distance between source and target; (3) select the source training samples that are closer to the target to fine-tune the source classifiers; and (4) classify each encoded target feature by corresponding source classifier, and aggregate different predictions using respective domain weight, which corresponds to the discrepancy between each source and target. Extensive experiments are conducted on public DA benchmarks, and the results demonstrate that the proposed MDDA significantly outperforms the state-of-the-art approaches. Our source code is released at: <a class="link-external link-https" href="https://github.com/daoyuan98/MDDA" rel="external noopener nofollow">this https URL</a>.

Multiple-source Domain Adaptation with Generative Adversarial Nets

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

Multiple Source Domain Adaptation with Adversarial Training of Neural Networks

Adversarial Multiple Source Domain Adaptation.

Multi-source Domain Adaptation for Visual Sentiment Classification

Multi-Source and Multi-Target Domain Adaptation Based on Dynamic Generator With Attention

Multi-Source Unsupervised Domain Adaptation Via Pseudo Target Domain

MADAN: Multi-source Adversarial Domain Aggregation Network for Domain Adaptation

Generalization Bound for Multiple Source Domain Adaptation

MultiDAN: Unsupervised, Multistage, Multisource and Multitarget Domain Adaptation for Semantic Segmentation of Remote Sensing Images

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

Duplex Adversarial Networks for Multiple-Source Domain Adaptation.

Multi-source Domain Adaptation for Semantic Segmentation

MSGAN: Multi-Stage Generative Adversarial Networks for Cross-Modality Domain Adaptation.

Deep Cycle Autoencoder for Unsupervised Domain Adaptation with Generative Adversarial Networks

Unsupervised Multi-Source Domain Adaptation with Graph Convolution Network and Multi-Alignment in Mixed Latent Space

Universal multi-Source domain adaptation for image classification

Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey

Mdalu: Multi-Source Domain Adaptation and Label Unification with Partial Datasets

Multiple Adversarial Networks for Unsupervised Domain Adaptation

Multi-source Distilling Domain Adaptation