Abstract:Unsupervised domain adaptation has attracted appealing academic attentions by transferring knowledge from labeled source domain to unlabeled target domain. However, most existing methods assume the source data are drawn from a single domain, which cannot be successfully applied to explore complementarily transferable knowledge from multiple source domains with large distribution discrepancies. Moreover, they require access to source data during training, which are inefficient and unpractical due to privacy preservation and memory storage. To address these challenges, we develop a novel Confident-Anchor-induced multi-source-free Domain Adaptation (CAiDA) model, which is a pioneer exploration of knowledge adaptation from multiple source domains to the unlabeled target domain without any source data, but with only pre-trained source models. Specifically, a source-specific transferable perception module is proposed to automatically quantify the contributions of the complementary knowledge transferred from multi-source domains to the target domain. To generate pseudo labels for the target domain without access to the source data, we develop a confident-anchor-induced pseudo label generator by constructing a confident anchor group and assigning each unconfident target sample with a semantic-nearest confident anchor. Furthermore, a class-relationship-aware consistency loss is proposed to preserve consistent inter-class relationships by aligning soft confusion matrices across domains. Theoretical analysis answers why multi-source domains are better than a single source domain, and establishes a novel learning bound to show the effectiveness of exploiting multi-source domains. Experiments on several representative datasets illustrate the superiority of our proposed CAiDA model. The code is available at https://github.com/Learning-group123/CAiDA

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

A Framework for Self-Supervised Federated Domain Adaptation

Discriminability and Transferability Estimation: A Bayesian Source Importance Estimation Approach for Multi-Source-Free Domain Adaptation.

Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation

Generation, Augmentation, and Alignment: A Pseudo-Source Domain Based Method for Source-Free Domain Adaptation.

Source-Free Domain Adaptation Via Distribution Estimation

Multi-source-free Domain Adaptive Object Detection

Unified Source-Free Domain Adaptation

Source-Free Domain Adaptation Via Target Prediction Distribution Searching

Imbalanced Source-free Domain Adaptation

A Comprehensive Survey on Source-Free Domain Adaptation

Transformer-Based Source-Free Domain Adaptation

Multi-source-free Domain Adaptation via Uncertainty-aware Adaptive Distillation

Casting a BAIT for Offline and Online Source-free Domain Adaptation

What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Context

Multi-source Distilling Domain Adaptation

Confident-Anchor-Induced Multi-Source-Free Domain Adaptation

UC-SFDA: Source-free Domain Adaptation Via Uncertainty Prediction and Evidence-Based Contrastive Learning

Co-MDA: Federated Multisource Domain Adaptation on Black-Box Models

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation