Abstract:Adversarial learning has proven to be an effective method for capturing transferable features for unsupervised domain adaptation. However, some existing conditional adversarial domain adaptation methods assign equal importance to different samples, ignoring the fact that hard-to-transfer samples might damage the conditional adversarial adaptation procedure. Meanwhile, some methods can only roughly align marginal distributions across domains, but cannot ensure category distributions alignment, causing classifiers to make uncertain or even wrong predictions for some target data. Furthermore, we find that the feature norms of real images usually follow a complex distribution, so directly matching the mean feature norms of two domains cannot effectively reduce the statistical discrepancy of feature norms and may potentially induce feature degradation. In this paper, we develop a Trust-aware Conditional Adversarial Domain Adaptation (TCADA) method for solving the aforementioned issues. To quantify data transferability, we suggest utilizing posterior probability modeled by a Gaussian-uniform mixture, which effectively facilitates conditional domain alignment. Based on this posterior probability, a confidence-guided alignment strategy is presented to promote precise alignment of category distributions and accelerate the learning of shared features. Moreover, a novel optimal transport-based strategy is introduced to align the feature norms and facilitate shared features becoming more informative. To encourage classifiers to make more accurate predictions for target data, we also design a mixed information-guided entropy regularization term to promote deep features being away from the decision boundaries. Extensive experiments show that our method greatly improves transfer performance on various tasks.

Understanding How Feature Structure Transfers in Transfer Learning.

Transfer Learning and Deep Domain Adaptation

Trust-aware Conditional Adversarial Domain Adaptation with Feature Norm Alignment.

Features are fate: a theory of transfer learning in high-dimensional regression

Learning explicitly transferable representations for domain adaptation

Transfer Learning by Reusing Structured Knowledge

What is being transferred in transfer learning?

Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning

Structure-constrain Source Free Domain Adaptation with Regularized Knowledge Distillation of Source Model

Towards Understanding Transfer Learning Algorithms Using Meta Transfer Features

Hierarchical Domain Adaptation with Local Feature Patterns

Transferring knowledge from human-demonstration trajectories to reinforcement learning

Learning Transferable and Discriminative Features for Unsupervised Domain Adaptation

Towards Understanding the Transferability of Deep Representations

Feature-based Distant Domain Transfer Learning.

Deep Transfer Learning: Model Framework and Error Analysis

Domain Transfer via Multiple Sources Regularization.

Geometric Understanding of Discriminability and Transferability for Visual Domain Adaptation

A Mathematical Framework for Quantifying Transferability in Multi-source Transfer Learning

Transductive transfer broad learning for cross-domain information exploration and multigrade soft sensor application

Domain Adaptation via Transfer Component Analysis