Abstract:Unsupervised Domain Adaptation (UDA) aims to learn a classifier for the unlabeled target domain by leveraging knowledge from a labeled source domain with a different but related distribution. Many existing approaches typically learn a domain-invariant representation space by directly matching the marginal distributions of the two domains. However, they ignore exploring the underlying discriminative features of the target data and align the cross-domain discriminative features, which may lead to suboptimal performance. To tackle these two issues simultaneously, this paper presents a Joint Clustering and Discriminative Feature Alignment (JCDFA) approach for UDA, which is capable of naturally unifying the mining of discriminative features and the alignment of class-discriminative features into one single framework. Specifically, in order to mine the intrinsic discriminative information of the unlabeled target data, JCDFA jointly learns a shared encoding representation for two tasks: supervised classification of labeled source data, and discriminative clustering of unlabeled target data, where the classification of the source domain can guide the clustering learning of the target domain to locate the object category. We then conduct the cross-domain discriminative feature alignment by separately optimizing two new metrics: 1) an extended supervised contrastive learning, i.e., semi-supervised contrastive learning 2) an extended Maximum Mean Discrepancy (MMD), i.e., conditional MMD, explicitly minimizing the intra-class dispersion and maximizing the inter-class compactness. When these two procedures, i.e., discriminative features mining and alignment are integrated into one framework, they tend to benefit from each other to enhance the final performance from a cooperative learning perspective. Experiments are conducted on four real-world benchmarks (e.g., Office-31, ImageCLEF-DA, Office-Home and VisDA-C)- All the results demonstrate that our JCDFA can obtain remarkable margins over state-of-the-art domain adaptation methods. Comprehensive ablation studies also verify the importance of each key component of our proposed algorithm and the effectiveness of combining two learning strategies into a framework.

Teacher-Student Mutual Learning for efficient source-free unsupervised domain adaptation

MCKD: Mutually Collaborative Knowledge Distillation for Federated Domain Adaptation and Generalization

Federated Domain Adaptation via Pseudo-label Refinement

CLDA: Collaborative Learning for Enhanced Unsupervised Domain Adaptation

Progressive Cross-Domain Knowledge Distillation for Efficient Unsupervised Domain Adaptive Object Detection

Cross-domain Knowledge Collaboration for Blending-Target Domain Adaptation

Co-Teaching for Unsupervised Domain Adaptation and Expansion

Cross-Domain and Cross-Modal Knowledge Distillation in Domain Adaptation for 3D Semantic Segmentation

Adaptive Mutual Learning for Unsupervised Domain Adaptation

Kd3a: Unsupervised Multi-Source Decentralized Domain Adaptation Via Knowledge Distillation

Generation, division and training: A promising method for source-free unsupervised domain adaptation

Joint Clustering and Discriminative Feature Alignment for Unsupervised Domain Adaptation

Teacher-Student Competition for Unsupervised Domain Adaptation

CMT: Cross Mean Teacher Unsupervised Domain Adaptation for VHR Image Semantic Segmentation

Unsupervised Domain Adaptation on Person Reidentification Via Dual-Level Asymmetric Mutual Learning

Dual Classifier Adaptation: Source-Free UDA via Adaptive Pseudo-Labels Learning

Reliable hybrid knowledge distillation for multi-source domain adaptive object detection

Source-free Domain Adaptation Via Dynamic Pseudo Labeling and Self-supervision

Boosting Unsupervised Domain Adaptation with Soft Pseudo-label and Curriculum Learning

Cross-domain Self-supervised Learning for Domain Adaptation with Few Source Labels

Cross Domain Mean Approximation for Unsupervised Domain Adaptation.