Abstract:Source-free domain adaptation (SFDA) aims to adapt a source model trained on a fully-labeled source domain to a related but unlabeled target domain. While the source model is a key avenue for acquiring target pseudolabels, the generated pseudolabels may exhibit source bias. In the conventional SFDA pipeline, a large data (e.g. ImageNet) pre-trained feature extractor is used to initialize the source model at the start of source training, and subsequently discarded. Despite having diverse features important for generalization, the pre-trained feature extractor can overfit to the source data distribution during source training and forget relevant target domain knowledge. Rather than discarding this valuable knowledge, we introduce an integrated framework to incorporate pre-trained networks into the target adaptation process. The proposed framework is flexible and allows us to plug modern pre-trained networks into the adaptation process to leverage their stronger representation learning capabilities. For adaptation, we propose the Co-learn algorithm to improve target pseudolabel quality collaboratively through the source model and a pre-trained feature extractor. Building on the recent success of the vision-language model CLIP in zero-shot image recognition, we present an extension Co-learn++ to further incorporate CLIP's zero-shot classification decisions. We evaluate on 4 benchmark datasets and include more challenging scenarios such as open-set, partial-set and open-partial SFDA. Experimental results demonstrate that our proposed strategy improves adaptation performance and can be successfully integrated with existing SFDA methods. Project code is available at <a class="link-external link-https" href="https://github.com/zwenyu/colearn-plus" rel="external noopener nofollow">this https URL</a>.

Unified Source-Free Domain Adaptation

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

A Framework for Self-Supervised Federated Domain Adaptation

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Context

A Comprehensive Survey on Source-Free Domain Adaptation

Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation

Transformer-Based Source-Free Domain Adaptation

Source-Free Domain Adaptation Via Target Prediction Distribution Searching

Source-Free Domain Adaptation Via Distribution Estimation

UC-SFDA: Source-free Domain Adaptation Via Uncertainty Prediction and Evidence-Based Contrastive Learning

Generation, Augmentation, and Alignment: A Pseudo-Source Domain Based Method for Source-Free Domain Adaptation.

Source-Free Domain Adaptation for Semantic Segmentation

Source-Free Domain Adaptation with Frozen Multimodal Foundation Model

Empowering Source-Free Domain Adaptation with MLLM-driven Curriculum Learning

Source-Free Unsupervised Domain Adaptation with Hypothesis Consolidation of Prediction Rationale

Unleashing Knowledge Potential of Source Hypothesis for Source-Free Domain Adaptation

High-order Neighborhoods Know More: HyperGraph Learning Meets Source-free Unsupervised Domain Adaptation

Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training

Imbalanced Source-free Domain Adaptation