Abstract:Multi-Source Domain Adaptation (MSDA) focuses on transferring the knowledge from multiple source domains to the target domain, which is a more practical and challenging problem compared to the conventional single-source domain adaptation. In this problem, it is essential to model multiple source domains and target domain jointly, and an effective domain combination scheme is also highly required. The graphical structure among different domains is useful to tackle these challenges, in which the interdependency among various instances/categories can be effectively modeled. In this work, we propose two types of graphical models, i.e. Conditional Random Field for MSDA (CRF-MSDA) and Markov Random Field for MSDA (MRF-MSDA), for cross-domain joint modeling and learnable domain combination. In a nutshell, given an observation set composed of a query sample and the semantic prototypes (i.e. representative category embeddings) on various domains, the CRF-MSDA model seeks to learn the joint distribution of labels conditioned on the observations. We attain this goal by constructing a relational graph over all observations and conducting local message passing on it. By comparison, MRF-MSDA aims to model the joint distribution of observations over different Markov networks via an energy-based formulation, and it can naturally perform label prediction by summing the joint likelihoods over several specific networks. Compared to the CRF-MSDA counterpart, the MRF-MSDA model is more expressive and possesses lower computational cost. We evaluate these two models on four standard benchmark data sets of MSDA with distinct domain shift and data complexity, and both models achieve superior performance over existing methods on all benchmarks. In addition, the analytical studies illustrate the effect of different model components and provide insights about how the cross-domain joint modeling performs.

Domain Adaptation As a Problem of Inference on Graphical Models.

Domain adaptation as a problem of inference on graphical models

Domain Adaptation with Few Labeled Source Samples by Graph Regularization

Data-Driven Approach to Multiple-Source Domain Adaptation

Dynamic Domain Adaptation for Efficient Inference

Domain adaptation with invariant representation learning: What transformations to learn?

Multi-source domain adaptation: A causal view

Domain-invariant Graph for Adaptive Semi-supervised Domain Adaptation

Dynamic-graph-based Unsupervised Domain Adaptation

Domain Adaptation with Conditional Transferable Components

Domain Adaptation with Conditional Transferable Components.

Discriminative and Geometry-Aware Unsupervised Domain Adaptation

Learning Domain-invariant Graph for Adaptive Semi-supervised Domain Adaptation with Few Labeled Source Samples.

Graph Domain Adaptation: A Generative View

Graph-Relational Domain Adaptation

Multi-source Domain Adaptation with Graph Embedding and Adaptive Label Prediction.

Supervised Domain Adaptation using Graph Embedding

Domain-Aware Graph Network for Bridging Multi-Source Domain Adaptation

Joint Adversarial Domain Adaptation with Structural Graph Alignment

Graphical Modeling for Multi-Source Domain Adaptation.