Abstract:Unsupervised domain adaptation (UDA) aims to alleviate the domain shift by transferring knowledge learned from a labeled source dataset to an unlabeled target domain. Although UDA has seen promising progress recently, it requires access to data from both domains, making it problematic in source data-absent scenarios. In this article, we investigate a practical task source-free domain adaptation (SFDA) that alleviates the limitations of the widely studied UDA in simultaneously acquiring source and target data. In addition, we further study the imbalanced SFDA (ISFDA) problem, which addresses the intra-domain class imbalance and inter-domain label shift in SFDA. We observe two key issues in SFDA that: 1) target data form clusters in the representation space regardless of whether the target data points are aligned with the source classifier and 2) target samples with higher classification confidence are more reliable and have less variation in their classification confidence during adaptation. Motivated by these observations, we propose a unified method, named intrinsic consistency preservation with adaptively reliable samples (ICPR), to jointly cope with SFDA and ISFDA. Specifically, ICPR first encourages the intrinsic consistency in the predictions of neighbors for unlabeled samples with weak augmentation (standard flip-and-shift), regardless of their reliability. ICPR then generates strongly augmented views specifically for adaptively selected reliable samples and is trained to fix the intrinsic consistency between weakly and strongly augmented views of the same image concerning predictions of neighbors and their own. Additionally, we propose to use a prototype-like classifier to avoid the classification confusion caused by severe intra-domain class imbalance and inter-domain label shift. We demonstrate the effectiveness and general applicability of ICPR on six benchmarks of both SFDA and ISFDA tasks. The reproducible code of our proposed ICPR method is available at https://github.com/CFM-MSG/Code_ICPR.

Robust Domain Adaptation: Representations, Weights and Inductive Bias

On the inductive biases of deep domain adaptation

On Learning Invariant Representation for Domain Adaptation

Reducing Bias to Source Samples for Unsupervised Domain Adaptation

Make the U in UDA Matter: Invariant Consistency Learning for Unsupervised Domain Adaptation

Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation

Towards Trustworthy Unsupervised Domain Adaptation: A Representation Learning Perspective for Enhancing Robustness, Discrimination, and Generalization

Robust Unsupervised Domain Adaptation from A Corrupted Source

Dynamic bias alignment and discrimination enhancement for unsupervised domain adaptation

Re-weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation

Two stages domain invariant representation learners solve the large co-variate shift in unsupervised domain adaptation with two dimensional data domains

Dynamic Instance Domain Adaptation

Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling

FixBi: Bridging Domain Spaces for Unsupervised Domain Adaptation

Independent Feature Decomposition and Instance Alignment for Unsupervised Domain Adaptation

Subdomain adaptation via correlation alignment with entropy minimization for unsupervised domain adaptation

Hidden Covariate Shift: A Minimal Assumption For Domain Adaptation

Dirichlet-based Uncertainty Calibration for Active Domain Adaptation

Divergence-agnostic Unsupervised Domain Adaptation by Adversarial Attacks

Intrinsic Consistency Preservation with Adaptively Reliable Samples for Source-Free Domain Adaptation.

Domain Adaptation Via Maximizing Surrogate Mutual Information