Abstract:Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a labeled source domain to a different unlabeled target domain. Most existing UDA methods focus on learning domain-invariant feature representation, either from the domain level or category level, using convolution neural networks (CNNs)-based frameworks. One fundamental problem for the category level based UDA is the production of pseudo labels for samples in target domain, which are usually too noisy for accurate domain alignment, inevitably compromising the UDA performance. With the success of Transformer in various tasks, we find that the cross-attention in Transformer is robust to the noisy input pairs for better feature alignment, thus in this paper Transformer is adopted for the challenging UDA task. Specifically, to generate accurate input pairs, we design a two-way center-aware labeling algorithm to produce pseudo labels for target samples. Along with the pseudo labels, a weight-sharing triple-branch transformer framework is proposed to apply self-attention and cross-attention for source/target feature learning and source-target domain alignment, respectively. Such design explicitly enforces the framework to learn discriminative domain-specific and domain-invariant representations simultaneously. The proposed method is dubbed CDTrans (cross-domain transformer), and it provides one of the first attempts to solve UDA tasks with a pure transformer solution. Experiments show that our proposed method achieves the best performance on public UDA datasets, e.g. VisDA-2017 and DomainNet. Code and models are available at <a class="link-external link-https" href="https://github.com/CDTrans/CDTrans" rel="external noopener nofollow">this https URL</a>.

TransConv: Transformer Meets Contextual Convolution for Unsupervised Domain Adaptation

CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation

Learning cross-domain representations by vision transformer for unsupervised domain adaptation

Exploiting Both Domain-specific and Invariant Knowledge via a Win-win Transformer for Unsupervised Domain Adaptation

SemiCVT: Semi-Supervised Convolutional Vision Transformer for Semantic Segmentation

TransVQA: Transferable Vector Quantization Alignment for Unsupervised Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

Towards Unsupervised Domain Adaptation via Domain-Transformer

TransAdapter: Vision Transformer for Feature-Centric Unsupervised Domain Adaptation

Feature Fusion Transferability Aware Transformer for Unsupervised Domain Adaptation

Making the Best of Both Worlds: A Domain-Oriented Transformer for Unsupervised Domain Adaptation

Robust Core-Periphery Constrained Transformer for Domain Adaptation

Dynamic Unary Convolution in Transformers

Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer

DCST: Dual Cross-Supervision for Transformer-based Unsupervised Domain Adaptation

Transformer-Based Domain Adaptation for Event Data Classification

CTFCD: Channel Transformer Based on Full Convolutional Decoder for Single Image Deraining

Domain Adaptation Transformer for Unsupervised Driving-Scene Segmentation in Adverse Conditions

Safe Self-Refinement for Transformer-based Domain Adaptation

DeNKD: Decoupled Non-Target Knowledge Distillation for Complementing Transformer-based Unsupervised Domain Adaptation

Domain Adaptation via Bidirectional Cross-Attention Transformer