Abstract:Transfer learning has proved to be effective for building predictive models even in complex conditions with a low amount of available labeled data, by constructing a predictive model for a target domain also using the knowledge coming from a separate domain, called source domain. However, several existing transfer learning methods assume identical feature spaces between the source and the target domains. This assumption limits the possible real-world applications of such methods, since two separate, although related, domains could be described by totally different feature spaces. Heterogeneous transfer learning methods aim to overcome this limitation, but they usually i) make other assumptions on the features, such as requiring the same number of features, ii) are not generally able to distribute the workload over multiple computational nodes, iii) cannot work in the Positive-Unlabeled (PU) learning setting, which we also considered in this study, or iv) their applicability is limited to specific application domains, i.e., they are not general-purpose methods. In this manuscript, we present a novel distributed heterogeneous transfer learning method, implemented in Apache Spark, that overcomes all the above-mentioned limitations. Specifically, it is able to work also in the PU learning setting by resorting to a clustering-based approach, and can align totally heterogeneous feature spaces, without exploiting peculiarities of specific application domains. Moreover, our distributed approach allows us to process large source and target datasets. Our experimental evaluation was performed in three different application domains that can benefit from transfer learning approaches, namely the reconstruction of the human gene regulatory network, the prediction of cerebral stroke in hospital patients, and the prediction of customer energy consumption in power grids. The results show that the proposed approach is able to outperform 4 state-of-the-art heterogeneous transfer learning approaches and 3 baselines, and exhibits ideal performances in terms of scalability.

Scalable Heterogeneous Transfer Ranking.

TransRank: A Novel Algorithm for Transfer of Rank Learning

A Recent Survey of Heterogeneous Transfer Learning

A Survey on Heterogeneous Transfer Learning

Heterogeneous cross domain ranking in latent space

Pairwise cross-domain factor model for heterogeneous transfer ranking.

Online Heterogeneous Transfer Learning By Weighted Offline And Online Classifiers

Learning to rank in heterogeneous network

Homogeneous Online Transfer Learning with Online Distribution Discrepancy Minimization

Query-dependent cross-domain ranking in heterogeneous network

Distributed Heterogeneous Transfer Learning

Choosing Transfer Languages for Cross-Lingual Learning

A Framework for Supervised Heterogeneous Transfer Learning Using Dynamic Distribution Adaptation and Manifold Regularization

Exploiting High-Order Information in Heterogeneous Multi-Task Feature Learning.

Heterogeneous Transfer Learning for Image Classification.

Transfer Learning on Heterogenous Feature Spaces via Spectral Transformation

Transferring Knowledge Fragments for Learning Distance Metric from A Heterogeneous Domain

Online Heterogeneous Transfer Metric Learning.

Online Transfer Learning with Multiple Homogeneous or Heterogeneous Sources.

Low-Rank Transfer Learning for Multi-stream Data Classification