Abstract:Unsupervised domain adaptation (UDA) aims to alleviate the domain shift by transferring knowledge learned from a labeled source dataset to an unlabeled target domain. Although UDA has seen promising progress recently, it requires access to data from both domains, making it problematic in source data-absent scenarios. In this article, we investigate a practical task source-free domain adaptation (SFDA) that alleviates the limitations of the widely studied UDA in simultaneously acquiring source and target data. In addition, we further study the imbalanced SFDA (ISFDA) problem, which addresses the intra-domain class imbalance and inter-domain label shift in SFDA. We observe two key issues in SFDA that: 1) target data form clusters in the representation space regardless of whether the target data points are aligned with the source classifier and 2) target samples with higher classification confidence are more reliable and have less variation in their classification confidence during adaptation. Motivated by these observations, we propose a unified method, named intrinsic consistency preservation with adaptively reliable samples (ICPR), to jointly cope with SFDA and ISFDA. Specifically, ICPR first encourages the intrinsic consistency in the predictions of neighbors for unlabeled samples with weak augmentation (standard flip-and-shift), regardless of their reliability. ICPR then generates strongly augmented views specifically for adaptively selected reliable samples and is trained to fix the intrinsic consistency between weakly and strongly augmented views of the same image concerning predictions of neighbors and their own. Additionally, we propose to use a prototype-like classifier to avoid the classification confusion caused by severe intra-domain class imbalance and inter-domain label shift. We demonstrate the effectiveness and general applicability of ICPR on six benchmarks of both SFDA and ISFDA tasks. The reproducible code of our proposed ICPR method is available at https://github.com/CFM-MSG/Code_ICPR.

Exploring Domain-Invariant Parameters for Source Free Domain Adaptation

A Framework for Self-Supervised Federated Domain Adaptation

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

SIDE: Self-supervised Intermediate Domain Exploration for Source-free Domain Adaptation

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation

A Comprehensive Survey on Source-Free Domain Adaptation

Source-Free Domain Adaptation Via Target Prediction Distribution Searching

Source-Free Domain Adaptation Via Distribution Estimation

Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptation

Discriminative Pattern Calibration Mechanism for Source-Free Domain Adaptation

Transformer-Based Source-Free Domain Adaptation

Unified Source-Free Domain Adaptation

Imbalanced Source-free Domain Adaptation

Intrinsic Consistency Preservation with Adaptively Reliable Samples for Source-Free Domain Adaptation.

Proxy Denoising for Source-Free Domain Adaptation

DINE: Domain Adaptation from Single and Multiple Black-box Predictors

Source-Free Domain Adaptation with Frozen Multimodal Foundation Model

Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

Towards Dynamic-Prompting Collaboration for Source-Free Domain Adaptation