Abstract:Multi-Task Learning (MTL) has shown its effectiveness in real applications where many related tasks could be handled together. Existing MTL methods make predictions for multiple tasks based on the data examples of the corresponding tasks. However, the data examples of some tasks are expensive or time-consuming to collect in practice, which reduces the applicability of MTL. For example, a patient may be asked to provide her microtome test reports and MRI images for illness diagnosis in MTL-based system [37,40]. It would be valuable if MTL can predict the abnormalities for such medical tests by feeding with some easy-to-collect data examples from other related tests instead of directly collecting data examples from them. We term such a new paradigm as multi-task learning from partial examples. The challenges of partial multi-task learning are twofold. First, the data examples from different tasks may be represented in different feature spaces. Second, the data examples could be incomplete for predicting the labels of all tasks. To overcome these challenges, we in this paper propose a novel algorithm, named Generative Learning with Partial Multi-Tasks (GPMT). The key idea of GPMT is to discover a shared latent feature space that harmonizes disparate feature information of multiple tasks. Given a partial example, the information contained in its missing feature representations is recovered by projecting it onto the latent space. A learner trained on the latent space then enjoys complete information included in the original features and the recovered missing features, and thus can predict the labels for the partial examples. Our theoretical analysis shows that the GPMT guarantees a performance gain comparing with training an individual learner for each task. Extensive experiments demonstrate the superiority of GPMT on both synthetic and real datasets.

Learning from Easy to Hard: Multi-Task Learning with Data Scheduling.

Multiple Task Learning Using Iteratively Reweighted Least Square.

Unleashing the Power of Multi-Task Learning: A Comprehensive Survey Spanning Traditional, Deep, and Pretrained Foundation Model Eras

Beyond Shared Hierarchies: Deep Multitask Learning through Soft Layer Ordering

Multi-Task Learning with Group-Specific Feature Space Sharing

Learning to Teach Fairness-aware Deep Multi-task Learning

STG-MTL: Scalable Task Grouping for Multi-Task Learning Using Data Map

Multi-task Sparse Structure Learning

Equitable Multi-task Learning

Multi-task Classification with Sequential Instances and Tasks

Multi-Task Learning in Natural Language Processing: An Overview

Dual-Balancing for Multi-Task Learning

Multi-task Model and Feature Joint Learning

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs

Towards Impartial Multi-task Learning.

Task Grouping for Automated Multi-Task Machine Learning via Task Affinity Prediction

Semi-supervised Multi-task Learning for Semantics and Depth

Learning Functions to Study the Benefit of Multitask Learning

Model-Protected Multi-Task Learning

On Partial Multi-Task Learning.