Abstract:We consider a different setting from regular multitask learning, where data from different tasks share no common instances and no common feature dictionary, while the features can be semantically correlated and all tasks share the same class space. For example, in the two tasks of identifying terrorism information from English news and Arabic news respectively, one associated dataset could be news from Cable News Network (CNN), and the other be news crawled from websites of Arabic countries. Intuitively, these two tasks could help each other, although they share no common feature space. This new setting has brought obstacles to traditional multi-task learning algorithms and multi-view learning algorithms. We argue that these different data sources can be co-trained together by exploring the latent semantics among them. To this end, we propose a new graphical model based on sparse Gaussian Conditional Random Fields (GCRF) and Hilbert-Schmidt Independence Criterion (HSIC). In additional to output the prediction accuracy for each single task, it can also model (1) the dependency between the latent feature spaces of different tasks, (2) the dependency of the category spaces, and (3) the dependency between the latent feature space and the category space in each task. To make the model inference effective, we have provided an efficient variational EM algorithm. Experiments on both synthetic data sets and real-world data sets have indicated the feasibility and effectiveness of the proposed framework.

Distributed Multi-Task Learning with Shared Representation

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

Distributed Jointly Sparse Multitask Learning over Networks

Distributed Networked Multi-task Learning

Distributed Stochastic Multi-Task Learning with Graph Regularization

Adaptively Sharing Multi-Levels of Distributed Representations in Multi-Task Learning

Multitask Diffusion Adaptation over Networks with Common Latent Representations

Distributed Multi-Task Relationship Learning

Robust Task Grouping with Representative Tasks for Clustered Multi-Task Learning

Multitask Learning Over Graphs: An Approach for Distributed, Streaming Machine Learning

ESSR: Evolving Sparse Sharing Representation for Multi-task Learning

Same Representation, Different Attentions: Shareable Sentence Representation Learning from Multiple Tasks

Multi-Task Learning Via Sharing Inexact Low-Rank Subspace

Elaborate Multi-Task Subspace Learning with Discrete Group Constraint

Byzantine Resilient Distributed Multi-Task Learning

Sharing Knowledge in Multi-Task Deep Reinforcement Learning

Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning

Co-Clustering for Multitask Learning

Deep Multi-Task Learning with Shared Memory

Learning from Semantically Dependent Multi-Tasks

Learning Sparse Sharing Architectures for Multiple Tasks.