Abstract:Unsupervised domain adaptation addresses the problem of classifying data in an unlabeled target domain, given labeled source domain data that share a common label space but follow a different distribution. Most of the recent methods take the approach of explicitly aligning feature distributions between the two domains. Differently, motivated by the fundamental assumption for domain adaptability, we re-cast the domain adaptation problem as discriminative clustering of target data, given strong privileged information provided by the closely related, labeled source data. Technically, we use clustering objectives based on a robust variant of entropy minimization that adaptively filters target data, a soft Fisher-like criterion, and additionally the cluster ordering via centroid classification. To distill discriminative source information for target clustering, we propose to jointly train the network using parallel, supervised learning objectives over labeled source data. We term our method of distilled discriminative clustering for domain adaptation as DisClusterDA. We also give geometric intuition that illustrates how constituent objectives of DisClusterDA help learn class-wisely pure, compact feature distributions. We conduct careful ablation studies and extensive experiments on five popular benchmark datasets, including a multi-source domain adaptation one. Based on commonly used backbone networks, DisClusterDA outperforms existing methods on these benchmarks. It is also interesting to observe that in our DisClusterDA framework, adding an additional loss term that explicitly learns to align class-level feature distributions across domains does harm to the adaptation performance, though more careful studies in different algorithmic frameworks are to be conducted.

Context-guided entropy minimization for semi-supervised domain adaptation

Federated Domain Adaptation via Pseudo-label Refinement

Entropy Minimization vs. Diversity Maximization for Domain Adaptation

Meta-Tsallis-Entropy Minimization: A New Self-Training Approach for Domain Adaptation on Text Classification

Adversarial Entropy Optimization for Unsupervised Domain Adaptation

Weakly-Supervised Domain Adaptation With Adversarial Entropy for Building Segmentation in Cross-Domain Aerial Imagery

Neutral Cross-Entropy Loss Based Unsupervised Domain Adaptation for Semantic Segmentation

Entropy Guided Adversarial Domain Adaptation for Aerial Image Semantic Segmentation

Fully Test-time Adaptation by Entropy Minimization

Unsupervised Domain Adaptation with Target Reconstruction and Label Confusion in the Common Subspace

Adaptive Mutual Learning for Unsupervised Domain Adaptation

Semi-Supervised Hypothesis Transfer for Source-Free Domain Adaptation

Information Maximizing Adaptation Network With Label Distribution Priors for Unsupervised Domain Adaptation

Unsupervised Domain Adaptive Image Semantic Segmentation Based on Convolutional Fine-Grained Discriminant and Entropy Minimization

Source-free semi-supervised domain adaptation via progressive Mixup

Information Selection-based Domain Adaptation from Black-box Predictors.

Unsupervised domain adaptation via distilled discriminative clustering

EmotionGAN: Unsupervised Domain Adaptation for Learning Discrete Probability Distributions of Image Emotions.

Cross-domain error minimization for unsupervised domain adaptation

Uncertainty-Guided Mixup for Semi-Supervised Domain Adaptation without Source Data.

Source-Free Unsupervised Domain Adaptation in Imbalanced Datasets