Abstract:Unsupervised domain adaptation (UDA) deals with the problem of transferring knowledge from a labeled source domain to an unlabeled target domain when the two domains have distinct data distributions. Therefore, the purpose of domain adaptation is to mitigate the distribution divergence between the two domains. Many existing UDA methods only use the traditional batch normalization layer, but this may lead to a large number of feature redundancy and lead performance degradation. In this paper, we in-troduce a novel deep learning paradigm called feature redundancy in UDA to enhance adaptation ability. Specifically, we first show that feature redundancy also exists on unsupervised domain adaptation (UDA), which has been ignored by most previous effort s. We utilize feature similarity as a metric to measure feature redundancy and then analyze the relationship between uniform feature spectrum and minimal feature similarity. Based on this relationship, we intend to reduce cross-domain feature redundancy for UDA by making the distribution of feature spectrum uniforms in a bi-level way. For the first level, we pro-pose a cross-domain batch normalization with the whitening module (xBN) to ensure compact domain-specific features and learn domain-invariant features at the same time. With the domain-specific features from the first level that paves a way, on the second level, we suggest an alternative orthogonal regular-izer (OR) that can make the distribution of the feature spectrum more uniform, thus domain-invariant feature redundancy is mitigated. Such a bi-level mechanism greatly reduces the feature redundancy for UDA. To evaluate the efficacy of the proposed bi-level mechanism, we plug those two novel modules (i.e., xBN and OR) into convolutional neural networks (CNNs) to form our UDA model and also conduct the corresponding empirical evaluations on five cross-domain object recognition benchmarks including both classical and large-scale image datasets. Experimental results show that the proposed UDA model could achieve state-of-the-art performance both in quantity and quality. Our source codes will be released after publication. (c) 2023 Elsevier Ltd. All rights reserved.

Reducing Source-Private Bias in Extreme Universal Domain Adaptation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Universal Semi-Supervised Domain Adaptation by Mitigating Common-Class Bias

Unified Optimal Transport Framework for Universal Domain Adaptation

Domain Consensus Clustering for Universal Domain Adaptation

LEAD: Learning Decomposition for Source-free Universal Domain Adaptation

Reducing Bias to Source Samples for Unsupervised Domain Adaptation

Exploiting Inter-Sample Affinity for Knowability-Aware Universal Domain Adaptation

On Universal Black-Box Domain Adaptation

Unsupervised Domain Adaptation: an Adaptive Feature Norm Approach

Online Unsupervised Domain Adaptation Via Reducing Inter- and Intra-Domain Discrepancies

Divergence-agnostic Unsupervised Domain Adaptation by Adversarial Attacks

HyUniDA: Breaking Label Set Constraints for Universal Domain Adaptation in Cross-Scene Hyperspectral Image Classification

Universal Domain Adaptive Object Detection via Dual Probabilistic Alignment

Reducing Bi-Level Feature Redundancy for Unsupervised Domain Adaptation

Source Protection Domain Adaptation by Gumbel-Min-Max Entropy Minimization

Domain Gap Estimation for Source Free Unsupervised Domain Adaptation with Many Classifiers

Dynamic bias alignment and discrimination enhancement for unsupervised domain adaptation

Universal domain adaptation

Enhanced Unsupervised Domain Adaptation with Dual-Attention Between Classification and Domain Alignment.