Abstract:Unsupervised domain adaptation (UDA) makes predictions for the target domain data while manual annotations are only available in the source domain. Previous methods minimize the domain discrepancy neglecting the class information, which may lead to misalignment and poor generalization performance. To tackle this issue, this paper proposes contrastive adaptation network (CAN) that optimizes a new metric named Contrastive Domain Discrepancy explicitly modeling the intra-class domain discrepancy and the inter-class domain discrepancy. To optimize CAN, two technical issues need to be addressed: 1) the target labels are not available; and 2) the conventional mini-batch sampling is imbalanced. Thus we design an alternating update strategy to optimize both the target label estimations and the feature representations. Moreover, we develop class-aware sampling to enable more efficient and effective training. Our framework can be generally applied to the single-source and multi-source domain adaptation scenarios. In particular, to deal with multiple source domain data, we propose: 1) multi-source clustering ensemble which exploits the complementary knowledge of distinct source domains to make more accurate and robust target label estimations; and 2) boundary-sensitive alignment to make the decision boundary better fitted to the target. Experiments are conducted on three real-world benchmarks (i.e., Office-31 and VisDA-2017 for the single-source scenario, DomainNet for the multi-source scenario). All the results demonstrate that our CAN performs favorably against the state-of-the-art methods. Ablation studies also verify the effectiveness of each key component of our proposed system.

Unsupervised Multi-Target Domain Adaptation Incremental Method Based on Contrastive Learning

Task-oriented Contrastive Learning for Unsupervised Domain Adaptation.

Incremental learning based multi-domain adaptation for object detection

Dual Contrastive Universal Adaptation Network.

Towards Adaptive Multi-Scale Intermediate Domain Via Progressive Training for Unsupervised Domain Adaptation

Multi-Source domain adaptation via supervised contrastive learning and confident consistency regularization

Contrastive Adaptation Network for Single- and Multi-Source Domain Adaptation

CMFT: Contrastive Memory Feature Transfer for Non-shared-and-Imbalanced Unsupervised Domain Adaption

Energy Transfer Contrast Network for Unsupervised Domain Adaption

Contrastive Adaptation Network for Unsupervised Domain Adaptation.

Multi-Target Domain Adaptation with Collaborative Consistency Learning

Unsupervised domain adaptation via coarse-to-fine feature alignment method using contrastive learning

Unsupervised Domain Adaptation by Cross-Prototype Contrastive Learning for Medical Image Segmentation.

Adaptive Mutual Learning for Unsupervised Domain Adaptation

Domain consensual contrastive learning for few-shot universal domain adaptation

Cross-domain Contrastive Learning for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation for Cross-Scene Hyperspectral Image Classification Based on Decoupled Contrastive Learning

CMFT: Contrastive Memory Feature Transfer for Nonshared-and-Imbalanced Unsupervised Domain Adaption

Enhanced Unsupervised Domain Adaptation with Dual-Attention Between Classification and Domain Alignment.

Domain Adaption Object Detection with Global - Local Contrastive Learning and Co-training Network.

A Unified Adversarial Learning Framework for Semi-supervised Multi-target Domain Adaptation