Abstract:Multi-source domain adaptation addresses the problem of transferring knowledge from multiple source domains to a target domain. Compared with conventional domain adaptation with single source and target domain, multi-source domain adaptation is more challenging because there are discrepancies not only across the source domains and the target domain, but also in source domains themselves. Hence, previous single-source domain adaptation methods may be suboptimal in handling multi-source scenarios. In this paper, we propose a multi-source domain adaptation method with graph embedding and adaptive label prediction to tackle the challenge. Specifically, our method leverages subspace learning and label prediction to mitigate both the inter-domain and intra-domain discrepancies. From the view of probability distribution, we match the firstorder moment maximum mean discrepancy (MMD) to reduce the distribution divergence. From the view of sample relationship, we deploy graph embedding to preserve the similarity and discriminability of samples from different domains. Moment matching and geometry alignment are optimized in a unified objective to learn a subspace where both inter-domain and intradomain discrepancies are reduced. For the label prediction, with the new representations learned in the subspace, we utilize K-means clustering and structural risk minimization (SRM) to predict pseudo labels in both low-dimensional subspace and high-dimensional RKHS. Specifically, we report two different strategies (denoted as ALP-u and ALP-s, respectively) for pseudo-labeling in this paper. The proposed ALP-u and ALP-s are effective in different kinds of domain adaptation scenarios, including multi-source and single-source domain adaptation. Experiments on three benchmark datasets verify that our ALP-u and ALP-s can outperform state-of-the-arts by a large margin.

Unsupervised Multi-source Domain Adaptation for Regression

Multi-source domain adaptation for regression

Adversarial Multiple Source Domain Adaptation.

Unsupervised Multi-Target Domain Adaptation: An Information Theoretic Approach

Multi-source Domain Adaptation with Graph Embedding and Adaptive Label Prediction.

Generalization Bound for Multiple Source Domain Adaptation

Unsupervised Domain Adaptation: A Multi-task Learning-based Method

Model Adaptation: Unsupervised Domain Adaptation Without Source Data.

Multiple-source adaptation theory and algorithms

Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation

Multi-source Attention for Unsupervised Domain Adaptation

Semi-Supervised Hypothesis Transfer for Source-Free Domain Adaptation

A General Upper Bound for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

Source-Free Unsupervised Domain Adaptation in Imbalanced Datasets

Multiple Source Domain Adaptation with Adversarial Training of Neural Networks

Domain Gap Estimation for Source Free Unsupervised Domain Adaptation with Many Classifiers

Active Dynamic Weighting for multi-domain adaptation

A Survey of Multi-Source Domain Adaptation

Learning Smooth Representation for Unsupervised Domain Adaptation

Gradual Fine-Tuning with Graph Routing for Multi-Source Unsupervised Domain Adaptation