Abstract:Unsupervised domain adaptation has attracted appealing academic attentions by transferring knowledge from labeled source domain to unlabeled target domain. However, most existing methods assume the source data are drawn from a single domain, which cannot be successfully applied to explore complementarily transferable knowledge from multiple source domains with large distribution discrepancies. Moreover, they require access to source data during training, which are inefficient and unpractical due to privacy preservation and memory storage. To address these challenges, we develop a novel Confident-Anchor-induced multi-source-free Domain Adaptation (CAiDA) model, which is a pioneer exploration of knowledge adaptation from multiple source domains to the unlabeled target domain without any source data, but with only pre-trained source models. Specifically, a source-specific transferable perception module is proposed to automatically quantify the contributions of the complementary knowledge transferred from multi-source domains to the target domain. To generate pseudo labels for the target domain without access to the source data, we develop a confident-anchor-induced pseudo label generator by constructing a confident anchor group and assigning each unconfident target sample with a semantic-nearest confident anchor. Furthermore, a class-relationship-aware consistency loss is proposed to preserve consistent inter-class relationships by aligning soft confusion matrices across domains. Theoretical analysis answers why multi-source domains are better than a single source domain, and establishes a novel learning bound to show the effectiveness of exploiting multi-source domains. Experiments on several representative datasets illustrate the superiority of our proposed CAiDA model. The code is available at https://github.com/Learning-group123/CAiDA

Structure-constrain Source Free Domain Adaptation with Regularized Knowledge Distillation of Source Model

MCKD: Mutually Collaborative Knowledge Distillation for Federated Domain Adaptation and Generalization

A Framework for Self-Supervised Federated Domain Adaptation

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Multiple Source-Free Domain Adaptation Network Based on Knowledge Distillation for Machinery Fault Diagnosis

Hierarchical Unsupervised Relation Distillation for Source Free Domain Adaptation

SFDA-T: A novel source-free domain adaptation method with strong generalization ability for fault diagnosis

Semi-supervised Source-Free Domain Adaptation Method Via Diffusive Label Propagation for Rotating Machinery Fault Diagnosis

Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptation

Source-Free Domain Adaptation Via Distribution Estimation

Single-Source UDA for Privacy-Preserving Intelligent Fault Diagnosis Based on Domain augmentation

Teacher-Student Mutual Learning for efficient source-free unsupervised domain adaptation

Transformer-Based Source-Free Domain Adaptation

Source-Free Domain Adaptation with Frozen Multimodal Foundation Model

Source-Free Domain Adaptation Via Target Prediction Distribution Searching

Information Selection-based Domain Adaptation from Black-box Predictors.

Trust Your Good Friends: Source-Free Domain Adaptation by Reciprocal Neighborhood Clustering

Source-Free Domain Adaptation for Transferable Remaining Useful Life Prediction of Machine Considering Source Data Absence

Deep Discriminative Domain Adaptation.

Confident-Anchor-Induced Multi-Source-Free Domain Adaptation

Balance-blended adversarial distribution and smooth-suppressed labels refinement network for partial transfer fault diagnosis