Abstract:Multi-source domain adaptation addresses the problem of transferring knowledge from multiple source domains to a target domain. Compared with conventional domain adaptation with single source and target domain, multi-source domain adaptation is more challenging because there are discrepancies not only across the source domains and the target domain, but also in source domains themselves. Hence, previous single-source domain adaptation methods may be suboptimal in handling multi-source scenarios. In this paper, we propose a multi-source domain adaptation method with graph embedding and adaptive label prediction to tackle the challenge. Specifically, our method leverages subspace learning and label prediction to mitigate both the inter-domain and intra-domain discrepancies. From the view of probability distribution, we match the firstorder moment maximum mean discrepancy (MMD) to reduce the distribution divergence. From the view of sample relationship, we deploy graph embedding to preserve the similarity and discriminability of samples from different domains. Moment matching and geometry alignment are optimized in a unified objective to learn a subspace where both inter-domain and intradomain discrepancies are reduced. For the label prediction, with the new representations learned in the subspace, we utilize K-means clustering and structural risk minimization (SRM) to predict pseudo labels in both low-dimensional subspace and high-dimensional RKHS. Specifically, we report two different strategies (denoted as ALP-u and ALP-s, respectively) for pseudo-labeling in this paper. The proposed ALP-u and ALP-s are effective in different kinds of domain adaptation scenarios, including multi-source and single-source domain adaptation. Experiments on three benchmark datasets verify that our ALP-u and ALP-s can outperform state-of-the-arts by a large margin.

Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Multi-Source Domain Adaptation with Mixture of Joint Distributions

Multiple-source adaptation theory and algorithms

Online Multi-Source Domain Adaptation through Gaussian Mixtures and Dataset Dictionary Learning

Lighter, Better, Faster Multi-Source Domain Adaptation with Gaussian Mixture Models and Optimal Transport

Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

Multi-source Domain Adaptation with Graph Embedding and Adaptive Label Prediction.

Adaptive Learning Algorithm Based on Mixture Gaussian Background

Adversarial Mixup Ratio Confusion for Unsupervised Domain Adaptation.

Mixture Domain Adaptation to Improve Semantic Segmentation in Real-World Surveillance

Multiple Source Domain Adaptation with Adversarial Training of Neural Networks

Multi-source Fully Test-Time Adaptation

Optimal Transport for Domain Adaptation through Gaussian Mixture Models

Algorithm-Dependent Bounds for Representation Learning of Multi-Source Domain Adaptation

Distributionally Robust Machine Learning with Multi-source Data

How Does the Combined Risk Affect the Performance of Unsupervised Domain Adaptation Approaches?

Multi-Source Unsupervised Domain Adaptation Via Pseudo Target Domain

Multisource Heterogeneous Domain Adaptation With Conditional Weighting Adversarial Network

Unsupervised Multi-source Domain Adaptation for Regression

Multi-source Distilling Domain Adaptation