Abstract:Domain adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain-specialized features because most studies merely concentrate on domain-general feature learning in task-specific layers and integrate totally-shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely-shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi-path structure to separately excite channel activation for each domain. Such a partially-shared convnets module allows domain-specialized features in low-level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain-specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain-wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high-level feature distributions across domains, we consider deploying feature adaptation blocks after task-specific layers, which can explicitly mitigate the domain discrepancy. Extensive experiments on four cross-domain benchmarks, including DomainNet, Office-Home, Office-31, and ImageCLEF, demonstrate the proposed approaches outperform the existing methods by a large margin, especially on the large-scale challenging dataset. The code and models are available at https://github.com/BIT-DA/GDCAN.

Attention Guided for Partial Domain Adaptation.

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Deep Joint Two-Stream Wasserstein Auto-Encoder and Selective Attention Alignment for Unsupervised Domain Adaptation

Attention-based Adversarial Partial Domain Adaptation

From Big to Small: Adaptive Learning to Partial-Set Domains

Partial Transfer Learning with Selective Adversarial Networks

Mdalu: Multi-Source Domain Adaptation and Label Unification with Partial Datasets

Partial Adversarial Domain Adaptation

Partial Domain Adaptation for Scene Classification From Remote Sensing Imagery

Partial Domain Adaptation on Semantic Segmentation

MultiDAN: Unsupervised, Multistage, Multisource and Multitarget Domain Adaptation for Semantic Segmentation of Remote Sensing Images

Multiple Source Domain Adaptation with Adversarial Training of Neural Networks

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.

Partial Feature Selection and Alignment for Multi-Source Domain Adaptation

Deep Multi-Modality Adversarial Networks for Unsupervised Domain Adaptation

Generalized Domain Conditioned Adaptation Network

Adversarial Multiple Source Domain Adaptation.

Contrastive Adaptation Network for Single- and Multi-Source Domain Adaptation

Affinity Space Adaptation for Semantic Segmentation Across Domains

Self-Adaptive Partial Domain Adaptation