Abstract:Unsupervised domain adaptation (UDA) aims to alleviate the domain shift by transferring knowledge learned from a labeled source dataset to an unlabeled target domain. Although UDA has seen promising progress recently, it requires access to data from both domains, making it problematic in source data-absent scenarios. In this article, we investigate a practical task source-free domain adaptation (SFDA) that alleviates the limitations of the widely studied UDA in simultaneously acquiring source and target data. In addition, we further study the imbalanced SFDA (ISFDA) problem, which addresses the intra-domain class imbalance and inter-domain label shift in SFDA. We observe two key issues in SFDA that: 1) target data form clusters in the representation space regardless of whether the target data points are aligned with the source classifier and 2) target samples with higher classification confidence are more reliable and have less variation in their classification confidence during adaptation. Motivated by these observations, we propose a unified method, named intrinsic consistency preservation with adaptively reliable samples (ICPR), to jointly cope with SFDA and ISFDA. Specifically, ICPR first encourages the intrinsic consistency in the predictions of neighbors for unlabeled samples with weak augmentation (standard flip-and-shift), regardless of their reliability. ICPR then generates strongly augmented views specifically for adaptively selected reliable samples and is trained to fix the intrinsic consistency between weakly and strongly augmented views of the same image concerning predictions of neighbors and their own. Additionally, we propose to use a prototype-like classifier to avoid the classification confusion caused by severe intra-domain class imbalance and inter-domain label shift. We demonstrate the effectiveness and general applicability of ICPR on six benchmarks of both SFDA and ISFDA tasks. The reproducible code of our proposed ICPR method is available at https://github.com/CFM-MSG/Code_ICPR.

UC-SFDA: Source-free Domain Adaptation Via Uncertainty Prediction and Evidence-Based Contrastive Learning

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

A Framework for Self-Supervised Federated Domain Adaptation

Uncertainty-Induced Transferability Representation for Source-Free Unsupervised Domain Adaptation

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

Self-Mining the Confident Prototypes for Source-Free Unsupervised Domain Adaptation in Image Segmentation

What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Context

Unified Source-Free Domain Adaptation

Source-Free Unsupervised Domain Adaptation with Hypothesis Consolidation of Prediction Rationale

Uncertainty-guided Open-Set Source-Free Unsupervised Domain Adaptation with Target-private Class Segregation

Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learning

Evidential Multi-Source-Free Unsupervised Domain Adaptation.

Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation

Uncertainty-Aware Pseudo-Label Filtering for Source-Free Unsupervised Domain Adaptation

Multi-source-free Domain Adaptation via Uncertainty-aware Adaptive Distillation

Generation, Augmentation, and Alignment: A Pseudo-Source Domain Based Method for Source-Free Domain Adaptation.

Source-Free Domain Adaptation for Semantic Segmentation

Imbalanced Source-free Domain Adaptation

Intrinsic Consistency Preservation with Adaptively Reliable Samples for Source-Free Domain Adaptation.

A Comprehensive Survey on Source-Free Domain Adaptation