Abstract:Domain adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain-specialized features because most studies merely concentrate on domain-general feature learning in task-specific layers and integrate totally-shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely-shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi-path structure to separately excite channel activation for each domain. Such a partially-shared convnets module allows domain-specialized features in low-level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain-specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain-wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high-level feature distributions across domains, we consider deploying feature adaptation blocks after task-specific layers, which can explicitly mitigate the domain discrepancy. Extensive experiments on four cross-domain benchmarks, including DomainNet, Office-Home, Office-31, and ImageCLEF, demonstrate the proposed approaches outperform the existing methods by a large margin, especially on the large-scale challenging dataset. The code and models are available at https://github.com/BIT-DA/GDCAN.

Domain-Conditioned Normalization for Test-Time Domain Generalization.

Knowledge Distillation-based Domain-invariant Representation Learning for Domain Generalization

Generalized Domain Conditioned Adaptation Network

Domain Generalization Via Conditional Invariant Representations

NormAUG: Normalization-guided Augmentation for Domain Generalization

Learning to Optimize Domain Specific Normalization for Domain Generalization

DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalization

Domain Generalization in Time Series Forecasting

GradCa: Generalizing to Unseen Domains Via Gradient Calibration

Causality-inspired Latent Feature Augmentation for Single Domain Generalization

Domain generalization based on domain-specific adversarial learning

Constrained Maximum Cross-Domain Likelihood for Domain Generalization

Batch Normalization Embeddings for Deep Domain Generalization

DomainLab: A modular Python package for domain generalization in deep learning

Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalization

Generalizing to Unseen Domains: A Survey on Domain Generalization

Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalization

Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations

Domain Agnostic Conditional Invariant Predictions for Domain Generalization

Rethinking Domain Generalization: Discriminability and Generalizability