Abstract:The Unsupervised Domain Adaptation (UDA) methods aim to enhance feature transferability possibly at the expense of feature discriminability. Recently, contrastive representation learning has been applied to UDA as a promising approach. One way is to combine the mainstream domain adaptation method with contrastive self-supervised tasks. The other way uses contrastive learning to align class-conditional distributions according to the semantic structure information of source and target domains. Nevertheless, there are some limitations in two aspects. One is that optimal solutions for the contrastive self-supervised learning and the domain discrepancy minimization may not be consistent. The other is that contrastive learning uses pseudo label information of target domain to align class-conditional distributions, where the pseudo label information contains noise such that false positive and negative pairs would deteriorate the performance of contrastive learning. To address these issues, we propose Noise-robust cross-domain Contrastive Learning (NaCL) to directly realize the domain adaptation task via simultaneously learning the instance-wise discrimination and encoding semantic structures in intra- and inter-domain to the learned representation space. More specifically, we adopt topology-based selection on the target domain to detect and remove false positive and negative pairs in contrastive loss. Theoretically, we demonstrate that not only NaCL can be considered an example of Expectation Maximization (EM), but also accurate pseudo label information is beneficial for reducing the expected error on target domain. NaCL obtains superior results on three public benchmarks. Further, NaCL can also be applied to semi-supervised domain adaptation with only minor modifications, achieving advanced diagnostic performance on COVID-19 dataset. Code is available at https://github.com/jingzhengli/NaCL

Self-Training with Contrastive Learning for Adversarial Domain Adaptation

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

Contrastive Adversarial Training for Unsupervised Domain Adaptation

Adversarial Learning and Interpolation Consistency for Unsupervised Domain Adaptation

Cross-domain Contrastive Learning for Unsupervised Domain Adaptation

Self-Training with Label-Feature-Consistency for Domain Adaptation

Self-adaptive Re-weighted Adversarial Domain Adaptation

Improve Conditional Adversarial Domain Adaptation Using Self-Training.

Class Discriminative Adversarial Learning for Unsupervised Domain Adaptation

Adversarial Supervised Contrastive Learning

InCo: Intermediate Prototype Contrast for Unsupervised Domain Adaptation

TextAdapter: Self-supervised Domain Adaptation for Cross-domain Text Recognition

Spatio-temporal Contrastive Domain Adaptation for Action Recognition

Domain Adaptation with Contrastive and Adversarial Oriented Transferable Semantic Augmentation

Adversarial-Learned Loss for Domain Adaptation

Task-oriented Contrastive Learning for Unsupervised Domain Adaptation.

NaCL: noise-robust cross-domain contrastive learning for unsupervised domain adaptation

Domain consensual contrastive learning for few-shot universal domain adaptation

Adversarial Style Discrepancy Minimization for Unsupervised Domain Adaptation.

Structure-Conditioned Adversarial Learning for Unsupervised Domain Adaptation