Abstract:The Unsupervised Domain Adaptation (UDA) methods aim to enhance feature transferability possibly at the expense of feature discriminability. Recently, contrastive representation learning has been applied to UDA as a promising approach. One way is to combine the mainstream domain adaptation method with contrastive self-supervised tasks. The other way uses contrastive learning to align class-conditional distributions according to the semantic structure information of source and target domains. Nevertheless, there are some limitations in two aspects. One is that optimal solutions for the contrastive self-supervised learning and the domain discrepancy minimization may not be consistent. The other is that contrastive learning uses pseudo label information of target domain to align class-conditional distributions, where the pseudo label information contains noise such that false positive and negative pairs would deteriorate the performance of contrastive learning. To address these issues, we propose Noise-robust cross-domain Contrastive Learning (NaCL) to directly realize the domain adaptation task via simultaneously learning the instance-wise discrimination and encoding semantic structures in intra- and inter-domain to the learned representation space. More specifically, we adopt topology-based selection on the target domain to detect and remove false positive and negative pairs in contrastive loss. Theoretically, we demonstrate that not only NaCL can be considered an example of Expectation Maximization (EM), but also accurate pseudo label information is beneficial for reducing the expected error on target domain. NaCL obtains superior results on three public benchmarks. Further, NaCL can also be applied to semi-supervised domain adaptation with only minor modifications, achieving advanced diagnostic performance on COVID-19 dataset. Code is available at https://github.com/jingzhengli/NaCL

Bootstrap Contrastive Domain Adaptation

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Low-confidence Samples Matter for Domain Adaptation

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

CDA: Contrastive-adversarial Domain Adaptation

Probabilistic Contrastive Learning for Domain Adaptation

Contrastive Adversarial Training for Unsupervised Domain Adaptation

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

Self-degraded contrastive domain adaptation for industrial fault diagnosis with bi-imbalanced data

Contrast and Clustering: Learning Neighborhood Pair Representation for Source-free Domain Adaptation

InCo: Intermediate Prototype Contrast for Unsupervised Domain Adaptation

NaCL: noise-robust cross-domain contrastive learning for unsupervised domain adaptation

From Pretext to Purpose: Batch-Adaptive Self-Supervised Learning

Domain Contrast for Domain Adaptive Object Detection

Contrastive Adaptation Network for Unsupervised Domain Adaptation.

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Cross-domain Contrastive Learning for Unsupervised Domain Adaptation

Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learning

Prototypical Contrastive Domain Adaptation Network for Nonstationary EEG Classification

Unsupervised Domain Adaptive Object Detection using Forward-Backward Cyclic Adaptation

Unsupervised Domain Adaptation With Debiased Contrastive Learning and Support-Set Guided Pseudolabeling for Remote Sensing Images