Abstract:Domain adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain-specialized features because most studies merely concentrate on domain-general feature learning in task-specific layers and integrate totally-shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely-shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi-path structure to separately excite channel activation for each domain. Such a partially-shared convnets module allows domain-specialized features in low-level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain-specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain-wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high-level feature distributions across domains, we consider deploying feature adaptation blocks after task-specific layers, which can explicitly mitigate the domain discrepancy. Extensive experiments on four cross-domain benchmarks, including DomainNet, Office-Home, Office-31, and ImageCLEF, demonstrate the proposed approaches outperform the existing methods by a large margin, especially on the large-scale challenging dataset. The code and models are available at https://github.com/BIT-DA/GDCAN.

Domain generalization based on domain-specific adversarial learning

Knowledge Distillation-based Domain-invariant Representation Learning for Domain Generalization

Domain adversarial neural networks for domain generalization: when it works and how to improve

Deep Domain-Adversarial Image Generation for Domain Generalisation

Adaptive Domain Generalization via Online Disagreement Minimization

Multiple Domain-Adversarial Ensemble Learning for Domain Generalization

Domain Adversarial Active Learning for Domain Generalization Classification

Domain Generalization Via Entropy Regularization.

Rethinking Domain Generalization: Discriminability and Generalizability

Discrimination-Aware Domain Adversarial Neural Network

Towards Unsupervised Domain Generalization

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

Generic network for domain adaptation based on self-supervised learning and deep clustering

Domain Generalization by Learning and Removing Domain-specific Features

Domain Generalization Via Inter-Domain Alignment and Intra-Domain Expansion

DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalization

Multiple Source Domain Adaptation with Adversarial Training of Neural Networks

Generalized Domain Conditioned Adaptation Network

Generalization Bound for Multiple Source Domain Adaptation

Discriminative Partial Domain Adversarial Network

Domain Generalization Through the Lens of Angular Invariance