Abstract:Multi-Source Domain Adaptation (MSDA) focuses on transferring the knowledge from multiple source domains to the target domain, which is a more practical and challenging problem compared to the conventional single-source domain adaptation. In this problem, it is essential to model multiple source domains and target domain jointly, and an effective domain combination scheme is also highly required. The graphical structure among different domains is useful to tackle these challenges, in which the interdependency among various instances/categories can be effectively modeled. In this work, we propose two types of graphical models, i.e. Conditional Random Field for MSDA (CRF-MSDA) and Markov Random Field for MSDA (MRF-MSDA), for cross-domain joint modeling and learnable domain combination. In a nutshell, given an observation set composed of a query sample and the semantic prototypes (i.e. representative category embeddings) on various domains, the CRF-MSDA model seeks to learn the joint distribution of labels conditioned on the observations. We attain this goal by constructing a relational graph over all observations and conducting local message passing on it. By comparison, MRF-MSDA aims to model the joint distribution of observations over different Markov networks via an energy-based formulation, and it can naturally perform label prediction by summing the joint likelihoods over several specific networks. Compared to the CRF-MSDA counterpart, the MRF-MSDA model is more expressive and possesses lower computational cost. We evaluate these two models on four standard benchmark data sets of MSDA with distinct domain shift and data complexity, and both models achieve superior performance over existing methods on all benchmarks. In addition, the analytical studies illustrate the effect of different model components and provide insights about how the cross-domain joint modeling performs.

Selection, Ensemble, and Adaptation: Advancing Multi-Source-Free Domain Adaptation via Architecture Zoo

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

A Framework for Self-Supervised Federated Domain Adaptation

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

Iterative Refinement for Multi-Source Visual Domain Adaptation (extended Abstract).

Multi-source-free Domain Adaptive Object Detection

Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey

More is Better: Deep Domain Adaptation with Multiple Sources

Multi-Source Unsupervised Domain Adaptation with Prototype Aggregation

Graphical Modeling for Multi-Source Domain Adaptation.

Co-MDA: Federated Multisource Domain Adaptation on Black-Box Models

A Comprehensive Survey on Source-Free Domain Adaptation

A Multi-View Consistency Framework with Semi-Supervised Domain Adaptation

Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation

Universal Semi-Supervised Domain Adaptation by Mitigating Common-Class Bias

Source-Free Active Domain Adaptation Via Augmentation-Based Sample Query and Progressive Model Adaptation.

Cal-SFDA: Source-Free Domain-adaptive Semantic Segmentation with Differentiable Expected Calibration Error

Source-Free Open Compound Domain Adaptation in Semantic Segmentation

Two-stage Structural Information Enhancement for Source-Free Domain Adaptation

Generalized Source-Free Domain-adaptive Segmentation Via Reliable Knowledge Propagation