Abstract:Domain adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain-specialized features because most studies merely concentrate on domain-general feature learning in task-specific layers and integrate totally-shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely-shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi-path structure to separately excite channel activation for each domain. Such a partially-shared convnets module allows domain-specialized features in low-level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain-specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain-wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high-level feature distributions across domains, we consider deploying feature adaptation blocks after task-specific layers, which can explicitly mitigate the domain discrepancy. Extensive experiments on four cross-domain benchmarks, including DomainNet, Office-Home, Office-31, and ImageCLEF, demonstrate the proposed approaches outperform the existing methods by a large margin, especially on the large-scale challenging dataset. The code and models are available at https://github.com/BIT-DA/GDCAN.

Unsupervised Domain Adaptation via Deep Conditional Adaptation Network

Domain Adaptation and Image Classification Via Deep Conditional Adaptation Network

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Trust-aware Conditional Adversarial Domain Adaptation with Feature Norm Alignment.

Conditional adversarial domain adaptation

CANN: Coupled Approximation Neural Network for Partial Domain Adaptation

Unsupervised Domain Adaptation with Adversarial Distribution Adaptation Network.

Generalized Domain Conditioned Adaptation Network

Maximizing conditional independence for unsupervised domain adaptation

Dual Contrastive Universal Adaptation Network.

Discriminative Feature Adaptation Via Conditional Mean Discrepancy for Cross-Domain Text Classification

Domain Conditioned Adaptation Network

Importance-weighted Conditional Adversarial Network for Unsupervised Domain Adaptation.

Unsupervised Domain Adaptation Through Dynamically Aligning Both the Feature and Label Spaces

Conditional Independence Induced Unsupervised Domain Adaptation

Contrastive Adaptation Network for Unsupervised Domain Adaptation.

Re-weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation

Joint Clustering and Discriminative Feature Alignment for Unsupervised Domain Adaptation

Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iterate

Dual Classifier Adaptation: Source-Free UDA via Adaptive Pseudo-Labels Learning

Unsupervised domain adaptation via discriminative feature learning and classifier adaptation from center-based distances