Abstract:The Unsupervised Domain Adaptation (UDA) methods aim to enhance feature transferability possibly at the expense of feature discriminability. Recently, contrastive representation learning has been applied to UDA as a promising approach. One way is to combine the mainstream domain adaptation method with contrastive self-supervised tasks. The other way uses contrastive learning to align class-conditional distributions according to the semantic structure information of source and target domains. Nevertheless, there are some limitations in two aspects. One is that optimal solutions for the contrastive self-supervised learning and the domain discrepancy minimization may not be consistent. The other is that contrastive learning uses pseudo label information of target domain to align class-conditional distributions, where the pseudo label information contains noise such that false positive and negative pairs would deteriorate the performance of contrastive learning. To address these issues, we propose Noise-robust cross-domain Contrastive Learning (NaCL) to directly realize the domain adaptation task via simultaneously learning the instance-wise discrimination and encoding semantic structures in intra- and inter-domain to the learned representation space. More specifically, we adopt topology-based selection on the target domain to detect and remove false positive and negative pairs in contrastive loss. Theoretically, we demonstrate that not only NaCL can be considered an example of Expectation Maximization (EM), but also accurate pseudo label information is beneficial for reducing the expected error on target domain. NaCL obtains superior results on three public benchmarks. Further, NaCL can also be applied to semi-supervised domain adaptation with only minor modifications, achieving advanced diagnostic performance on COVID-19 dataset. Code is available at https://github.com/jingzhengli/NaCL

Low-Rank Correlation Learning for Unsupervised Domain Adaptation

Robust and High-Order Correlation Alignment for Unsupervised Domain Adaptation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Class-Level Adaptation Network with Self Training for Unsupervised Domain Adaptation

Deep Robust Low Rank Correlation with Unifying Clustering Structure for Cross Domain Adaptation

Subdomain adaptation via correlation alignment with entropy minimization for unsupervised domain adaptation

Unsupervised Domain Adaptation With Robust Deep Logistic Regression

Instance Correlation Graph for Unsupervised Domain Adaptation

Enhancing Unsupervised Domain Adaptation by Discriminative Relevance Regularization

NaCL: noise-robust cross-domain contrastive learning for unsupervised domain adaptation

Online Unsupervised Domain Adaptation Via Reducing Inter- and Intra-Domain Discrepancies

Learning Distribution-Matched Landmarks For Unsupervised Domain Adaptation

Soft Large Margin Clustering for Unsupervised Domain Adaptation

Return of Frustratingly Easy Domain Adaptation

Class Discriminative Adversarial Learning for Unsupervised Domain Adaptation

Deep Unsupervised Convolutional Domain Adaptation

Learning Transferable and Discriminative Features for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation with Joint Domain-Adversarial Reconstruction Networks

Nonconvex and discriminative transfer subspace learning for unsupervised domain adaptation

Overcoming Negative Transfer by Online Selection: Distant Domain Adaptation for Fault Diagnosis

CLDA: Collaborative Learning for Enhanced Unsupervised Domain Adaptation