Abstract:Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately. Despite the potential of multi-task learning to yield more powerful inference than single-task alternatives, prior work in this area has largely omitted uncertainty quantification. Our focus in this paper is a common multi-task problem in neuroimaging, where the goal is to understand the relationship between multiple cognitive task scores (or other subject-level assessments) and brain connectome data collected from imaging. We propose a framework for selective inference to address this problem, with the flexibility to: (i) jointly identify the relevant covariates for each task through a sparsity-inducing penalty, and (ii) conduct valid inference in a model based on the estimated sparsity structure. Our framework offers a new conditional procedure for inference, based on a refinement of the selection event that yields a tractable selection-adjusted likelihood. This gives an approximate system of estimating equations for maximum likelihood inference, solvable via a single convex optimization problem, and enables us to efficiently form confidence intervals with approximately the correct coverage. Applied to both simulated data and data from the Adolescent Brain Cognitive Development (ABCD) study, our selective inference methods yield tighter confidence intervals than commonly used alternatives, such as data splitting. We also demonstrate through simulations that multi-task learning with selective inference can more accurately recover true signals than single-task methods.

Bayesian learning of feature spaces for multitask regression

Bayesian learning of feature spaces for multitasks problems

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

Network Traffic Classification Via Non-Convex Multi-Task Feature Learning

Multi-Target Regression Via Robust Low-Rank Learning.

Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecasting

Traffic Flow and Speed Forecasting Through a Bayesian Deep Multi-Linear Relationship Network.

Additive Dynamic Bayesian Networks for Enhanced Feature Learning in Soft Sensor Modeling

On Multiplicative Multitask Feature Learning

Nonparametric Bayesian Multi-task Learning with Max-margin Posterior Regularization

Co-Clustering for Multitask Learning

Learning Random Fourier Features by Hybrid Constrained Optimization

Multitask Learning and Bandits via Robust Statistics

A Bayesian approach to multi-task learning with network lasso

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks

Bayesian Max-margin Multi-Task Learning with Data Augmentation.

Bayesian Low-Rank LeArning (Bella): A Practical Approach to Bayesian Neural Networks

Multi-Stage Multi-Task Feature Learning

Selective Inference for Sparse Multitask Regression with Applications in Neuroimaging

Stein Random Feature Regression

Low-Rank Deep Convolutional Neural Network for Multi-Task Learning