Abstract:Adversarial learning has proven to be an effective method for capturing transferable features for unsupervised domain adaptation. However, some existing conditional adversarial domain adaptation methods assign equal importance to different samples, ignoring the fact that hard-to-transfer samples might damage the conditional adversarial adaptation procedure. Meanwhile, some methods can only roughly align marginal distributions across domains, but cannot ensure category distributions alignment, causing classifiers to make uncertain or even wrong predictions for some target data. Furthermore, we find that the feature norms of real images usually follow a complex distribution, so directly matching the mean feature norms of two domains cannot effectively reduce the statistical discrepancy of feature norms and may potentially induce feature degradation. In this paper, we develop a Trust-aware Conditional Adversarial Domain Adaptation (TCADA) method for solving the aforementioned issues. To quantify data transferability, we suggest utilizing posterior probability modeled by a Gaussian-uniform mixture, which effectively facilitates conditional domain alignment. Based on this posterior probability, a confidence-guided alignment strategy is presented to promote precise alignment of category distributions and accelerate the learning of shared features. Moreover, a novel optimal transport-based strategy is introduced to align the feature norms and facilitate shared features becoming more informative. To encourage classifiers to make more accurate predictions for target data, we also design a mixed information-guided entropy regularization term to promote deep features being away from the decision boundaries. Extensive experiments show that our method greatly improves transfer performance on various tasks.

Target Domain Data induces Negative Transfer in Mixed Domain Training with Disjoint Classes

Trust-aware Conditional Adversarial Domain Adaptation with Feature Norm Alignment.

Partial Adversarial Domain Adaptation

Characterizing and Avoiding Negative Transfer

Discriminative Partial Domain Adversarial Network

A Survey on Negative Transfer

On the inductive biases of deep domain adaptation

Domain Adaptation under Target and Conditional Shift.

DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalization

An introduction to domain adaptation and transfer learning

ECDT - Exploiting Correlation Diversity for Knowledge Transfer in Partial Domain Adaptation.

Self-adaptive Re-weighted Adversarial Domain Adaptation

Reducing Source-Private Bias in Extreme Universal Domain Adaptation

Single-source domain adaptation with target and conditional shift

Partial Transfer Learning with Selective Adversarial Networks

Domain Adaptive Transfer Learning with Specialist Models

Discriminative active learning for domain adaptation

Domain Adaptation without Model Transferring

Class-unbalanced Domain Adaptation for Object Detection Via Dynamic Weighting Mechanism

Maximal Domain Independent Representations Improve Transfer Learning

Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data