Abstract:Transfer learning has benefited many real‐world applications where labeled data are abundant in source domains but scarce in the target domain. As there are usually multiple relevant domains where knowledge can be transferred, multiple source transfer learning (MSTL) has recently attracted much attention. However, we are facing two major challenges when applying MSTL. First, without knowledge about the difference between source and target domains, negative transfer occurs when knowledge is transferred from highly irrelevant sources. Second, existence of imbalanced distributions in classes, where examples in one class dominate, can lead to improper judgement on the source domains' relevance to the target task. Since existing MSTL methods are usually designed to transfer from relevant sources with balanced distributions, they will fail in applications where these two challenges persist. In this article, we propose a novel two‐phase framework to effectively transfer knowledge from multiple sources even when there exists irrelevant sources and imbalanced class distributions. First, an effective supervised local weight scheme is proposed to assign a proper weight to each source domain's classifier based on its ability of predicting accurately on each local region of the target domain. The second phase then learns a classifier for the target domain by solving an optimization problem which concerns both training error minimization and consistency with weighted predictions gained from source domains. A theoretical analysis shows that as the number of source domains increases, the probability that the proposed approach has an error greater than a bound is becoming exponentially small. We further extend the proposed approach to an online processing scenario to conduct transfer learning on continuously arriving data. Extensive experiments on disease prediction, spam filtering and intrusion detection datasets demonstrate that: (i) the proposed two‐phase approach outperforms existing MSTL approaches due to its ability of tackling negative transfer and imbalanced distribution challenges, and (ii) the proposed online approach achieves comparable performance to the offline scheme.

Online Transfer Learning from Multiple Sources Based on Local Classification Accuracy

Online Transfer Learning with Multiple Source Domains for Multi-Class Classification.

OTLAMC: An Online Transfer Learning Algorithm for Multi-class Classification.

Online Transfer Learning by Leveraging Multiple Source Domains

Online Transfer Learning with Multiple Decision Trees

OMS-TL

OMS-TL: a framework of online multiple source transfer learning

Online Single Homogeneous Source Transfer Learning Based on AdaBoost

Enhancing classification performance through multi-source online transfer learning algorithm with oversampling

Online Transfer Learning with Multiple Homogeneous or Heterogeneous Sources.

A Local Online Learning Approach for Non-linear Data.

Homogeneous Online Transfer Learning with Online Distribution Discrepancy Minimization

A Buffered Online Transfer Learning Algorithm with Multi-Layer Network

Partial Feedback Online Transfer Learning with Multi-Source Domains

Multi-component transfer metric learning for handling unrelated source domain samples

Multi-source adversarial transfer learning based on similar source domains with local features

On handling negative transfer and imbalanced distributions in multiple source transfer learning

Instance-based Transfer Learning for Multi-source Domains

Knowledge transfer via multiple model local structure mapping

HetEOTL: an Algorithm for Heterogeneous Online Transfer Learning

Multi-source deep transfer learning algorithm based on feature alignment