Abstract:Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately. Despite the potential of multi-task learning to yield more powerful inference than single-task alternatives, prior work in this area has largely omitted uncertainty quantification. Our focus in this paper is a common multi-task problem in neuroimaging, where the goal is to understand the relationship between multiple cognitive task scores (or other subject-level assessments) and brain connectome data collected from imaging. We propose a framework for selective inference to address this problem, with the flexibility to: (i) jointly identify the relevant covariates for each task through a sparsity-inducing penalty, and (ii) conduct valid inference in a model based on the estimated sparsity structure. Our framework offers a new conditional procedure for inference, based on a refinement of the selection event that yields a tractable selection-adjusted likelihood. This gives an approximate system of estimating equations for maximum likelihood inference, solvable via a single convex optimization problem, and enables us to efficiently form confidence intervals with approximately the correct coverage. Applied to both simulated data and data from the Adolescent Brain Cognitive Development (ABCD) study, our selective inference methods yield tighter confidence intervals than commonly used alternatives, such as data splitting. We also demonstrate through simulations that multi-task learning with selective inference can more accurately recover true signals than single-task methods.

Sparse coding for multitask and transfer learning

Sparse Representation over Overcomplete Dictionary Based on Bayesian Nonparametric Approximation

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

Distributed Jointly Sparse Multitask Learning over Networks

Bayesian sparsity and class sparsity priors for dictionary learning and coding

Multimodal Task-Driven Dictionary Learning for Image Classification

Learning Task Grouping and Overlap in Multi-task Learning

Visual Classification with Multi-Task Joint Sparse Representation

Learning task structure via sparsity grouped multitask learning

Less is More -- Towards parsimonious multi-task models using structured sparsity

Robust multitask learning in high dimensions under memory constraint

Low Rank Multi-Dictionary Selection at Scale

Encoding Tree Sparsity in Multi-Task Learning: A Probabilistic Framework.

Dictionary learning under global sparsity constraint

Sparse Multitask Learning for Efficient Neural Representation of Motor Imagery and Execution

Learning Incoherent Sparse and Low-Rank Patterns from Multiple Tasks

Multi-level Discriminative Dictionary Learning with Application to Large Scale Image Classification.

Exploring the Role of Task Transferability in Large-Scale Multi-Task Learning

Sparse Coding and Dictionary Learning with Linear Dynamical Systems.

Selective Inference for Sparse Multitask Regression with Applications in Neuroimaging

Co-Clustering for Multitask Learning