Abstract:Multi-Task Learning (MTL) has shown its effectiveness in real applications where many related tasks could be handled together. Existing MTL methods make predictions for multiple tasks based on the data examples of the corresponding tasks. However, the data examples of some tasks are expensive or time-consuming to collect in practice, which reduces the applicability of MTL. For example, a patient may be asked to provide her microtome test reports and MRI images for illness diagnosis in MTL-based system [37,40]. It would be valuable if MTL can predict the abnormalities for such medical tests by feeding with some easy-to-collect data examples from other related tests instead of directly collecting data examples from them. We term such a new paradigm as multi-task learning from partial examples. The challenges of partial multi-task learning are twofold. First, the data examples from different tasks may be represented in different feature spaces. Second, the data examples could be incomplete for predicting the labels of all tasks. To overcome these challenges, we in this paper propose a novel algorithm, named Generative Learning with Partial Multi-Tasks (GPMT). The key idea of GPMT is to discover a shared latent feature space that harmonizes disparate feature information of multiple tasks. Given a partial example, the information contained in its missing feature representations is recovered by projecting it onto the latent space. A learner trained on the latent space then enjoys complete information included in the original features and the recovered missing features, and thus can predict the labels for the partial examples. Our theoretical analysis shows that the GPMT guarantees a performance gain comparing with training an individual learner for each task. Extensive experiments demonstrate the superiority of GPMT on both synthetic and real datasets.

Additive Multi-Task Learning Models and Task Diagnostics

Adaptive and Robust Multi-Task Learning

Multi-Task Learning with Summary Statistics

Efficiently Identifying Task Groupings for Multi-Task Learning

Using Multi-Task Learning to Improve Diagnostic Performance of Convolutional Neural Networks

Fitting and sharing multi-task learning

A Model-Agnostic Approach to Mitigate Gradient Interference for Multi-Task Learning

MTDiag: An Effective Multi-Task Framework for Automatic Diagnosis

AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning

Multi-Dimensional Ability Diagnosis for Machine Learning Algorithms

Learning Task Grouping and Overlap in Multi-task Learning

Learning Functions to Study the Benefit of Multitask Learning

AdaMerging: Adaptive Model Merging for Multi-Task Learning

Multi-Task Learning Architectures and Applications

On Multiplicative Multitask Feature Learning

Saliency-Regularized Deep Multi-Task Learning

Self-Paced Multi-Task Learning

On Partial Multi-Task Learning.

Multi-Task Learning as Multi-Objective Optimization

Robust Estimator Based Adaptive Multi-Task Learning

Multi-Task Learning for Alzheimer's Disease Diagnosis and Mini-Mental State Examination Score Prediction