Abstract:Multi-Task Learning (MTL) has shown its effectiveness in real applications where many related tasks could be handled together. Existing MTL methods make predictions for multiple tasks based on the data examples of the corresponding tasks. However, the data examples of some tasks are expensive or time-consuming to collect in practice, which reduces the applicability of MTL. For example, a patient may be asked to provide her microtome test reports and MRI images for illness diagnosis in MTL-based system [37,40]. It would be valuable if MTL can predict the abnormalities for such medical tests by feeding with some easy-to-collect data examples from other related tests instead of directly collecting data examples from them. We term such a new paradigm as multi-task learning from partial examples. The challenges of partial multi-task learning are twofold. First, the data examples from different tasks may be represented in different feature spaces. Second, the data examples could be incomplete for predicting the labels of all tasks. To overcome these challenges, we in this paper propose a novel algorithm, named Generative Learning with Partial Multi-Tasks (GPMT). The key idea of GPMT is to discover a shared latent feature space that harmonizes disparate feature information of multiple tasks. Given a partial example, the information contained in its missing feature representations is recovered by projecting it onto the latent space. A learner trained on the latent space then enjoys complete information included in the original features and the recovered missing features, and thus can predict the labels for the partial examples. Our theoretical analysis shows that the GPMT guarantees a performance gain comparing with training an individual learner for each task. Extensive experiments demonstrate the superiority of GPMT on both synthetic and real datasets.

Multi-Task Learning With Localized Generalization Error Model

On Partial Multi-Task Learning.

Localized generalization error model for Multilayer Perceptron Neural Networks

Multi-task Gradient Descent for Multi-Task Learning

Multi-task learning based on geometric invariance discriminative features

SGW-based Multi-Task Learning in Vision Tasks

Improving Multi-task Learning via Seeking Task-based Flat Regions

Grouped Multi-Task Learning with Hidden Tasks Enhancement

Modeling Output-Level Task Relatedness in Multi-Task Learning with Feedback Mechanism

Heterogeneous Multi-task Semantic Feature Learning for Classification

Towards Impartial Multi-task Learning.

Multi-task Model and Feature Joint Learning

Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation

Multiple Task Learning Using Iteratively Reweighted Least Square.

A Model-Agnostic Approach to Mitigate Gradient Interference for Multi-Task Learning

Task Variance Regularized Multi-Task Learning.

Semantic Feature Learning for Heterogeneous Multitask Classification Via Non-Negative Matrix Factorization.

Multi-Task Structural Learning using Local Task Similarity induced Neuron Creation and Removal

Network Clustering for Multi-task Learning

On Better Exploring and Exploiting Task Relationships in Multitask Learning: Joint Model and Feature Learning.

Task-group Relatedness and Generalization Bounds for Regularized Multi-task Learning.