Abstract:Domain transfer learning aims to learn common data representations from a source domain and a target domain so that the source domain data can help the classification of the target domain. Conventional transfer representation learning imposes the distributions of source and target domain representations to be similar, which heavily relies on the characterization of the distributions of domains and the distribution matching criteria. In this paper, we proposed a novel framework for domain transfer representation learning. Our motive is to make the learned representations of data points independent from the domains which they belong to. In other words, from an optimal cross-domain representation of a data point, it is difficult to tell which domain it is from. In this way, the learned representations can be generalized to different domains. To measure the dependency between the representations and the corresponding domain which the data points belong to, we propose to use the mutual information between the representations and the domain-belonging indicators. By minimizing such mutual information, we learn the representations which are independent from domains. We build a classwise deep convolutional network model as a representation model and maximize the margin of each data point of the corresponding class, which is defined over the intraclass and interclass neighborhood. To learn the parameters of the model, we construct a unified minimization problem where the margins are maximized while the representation-domain mutual information is minimized. In this way, we learn representations which are not only discriminate but also independent from domains. An iterative algorithm based on the Adam optimization method is proposed to solve the minimization to learn the classwise deep model parameters and the cross-domain representations simultaneously. Extensive experiments over benchmark datasets show its effectiveness and advantage over existing domain transfer learning methods.

Revised embedding based transfer learning

Feature-Based Transfer Learning Based on Distribution Similarity.

Coupled Knowledge Transfer for Visual Data Recognition

Instance-based Transfer Learning for Multi-source Domains

Multi-step Bridged Refinement for classifying cross-domian data

Multi-Step Bridged Refinement for Transfer Learning

Transferable and Differentiable Discrete Network Embedding for multi-domains with Hierarchical Knowledge Distillation

Embedding Transfer with Enhanced Correlation Modeling for Cross-Domain Recommendation.

Bridged Refinement For Transfer Learning

Discriminative Fisher Embedding Dictionary Transfer Learning for Object Recognition

Bridging Domains Using World Wide Knowledge for Transfer Learning

Feature-based Distant Domain Transfer Learning.

Relation Extraction Via Domain-aware Transfer Learning

Adaptive Local Neighbors for Transfer Discriminative Feature Learning.

Discriminative Transfer Learning Using Similarities and Dissimilarities

Learning Domain-Independent Deep Representations by Mutual Information Minimization

A New Belief-Based Bidirectional Transfer Classification Method

Dual-Space Transfer Learning Based on an Indirect Mutual Promotion Strategy.

Towards Accurate Knowledge Transfer Via Target-awareness Representation Disentanglement

Translated Learning: Transfer Learning Across Different Feature Spaces.

Deep representation-based transfer learning for deep neural networks