Abstract:Unsupervised domain adaptation (UDA) aims to alleviate the domain shift by transferring knowledge learned from a labeled source dataset to an unlabeled target domain. Although UDA has seen promising progress recently, it requires access to data from both domains, making it problematic in source data-absent scenarios. In this article, we investigate a practical task source-free domain adaptation (SFDA) that alleviates the limitations of the widely studied UDA in simultaneously acquiring source and target data. In addition, we further study the imbalanced SFDA (ISFDA) problem, which addresses the intra-domain class imbalance and inter-domain label shift in SFDA. We observe two key issues in SFDA that: 1) target data form clusters in the representation space regardless of whether the target data points are aligned with the source classifier and 2) target samples with higher classification confidence are more reliable and have less variation in their classification confidence during adaptation. Motivated by these observations, we propose a unified method, named intrinsic consistency preservation with adaptively reliable samples (ICPR), to jointly cope with SFDA and ISFDA. Specifically, ICPR first encourages the intrinsic consistency in the predictions of neighbors for unlabeled samples with weak augmentation (standard flip-and-shift), regardless of their reliability. ICPR then generates strongly augmented views specifically for adaptively selected reliable samples and is trained to fix the intrinsic consistency between weakly and strongly augmented views of the same image concerning predictions of neighbors and their own. Additionally, we propose to use a prototype-like classifier to avoid the classification confusion caused by severe intra-domain class imbalance and inter-domain label shift. We demonstrate the effectiveness and general applicability of ICPR on six benchmarks of both SFDA and ISFDA tasks. The reproducible code of our proposed ICPR method is available at https://github.com/CFM-MSG/Code_ICPR.

Imbalanced Source-free Domain Adaptation

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

A Framework for Self-Supervised Federated Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

Intrinsic Consistency Preservation with Adaptively Reliable Samples for Source-Free Domain Adaptation.

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

Source-Free Domain Adaptation Via Distribution Estimation

Imbalance-Agnostic Source-Free Domain Adaptation via Avatar Prototype Alignment

Generation, Augmentation, and Alignment: A Pseudo-Source Domain Based Method for Source-Free Domain Adaptation.

A Comprehensive Survey on Source-Free Domain Adaptation

Source-free Domain Adaptation Via Dynamic Pseudo Labeling and Self-supervision

Dual Classifier Adaptation: Source-Free UDA via Adaptive Pseudo-Labels Learning

Source-Free Implicit Semantic Augmentation for Domain Adaptation.

Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation

Multi-source-free Domain Adaptation via Uncertainty-aware Adaptive Distillation

Source bias reduction for source-free domain adaptation

Robust Self-Supervised Learning for Source-Free Domain Adaptation

Unified Source-Free Domain Adaptation

Source-Free Domain Adaptation for Semantic Segmentation

Source-Free Unsupervised Domain Adaptation with Hypothesis Consolidation of Prediction Rationale

UC-SFDA: Source-free Domain Adaptation Via Uncertainty Prediction and Evidence-Based Contrastive Learning