Abstract:Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately. Despite the potential of multi-task learning to yield more powerful inference than single-task alternatives, prior work in this area has largely omitted uncertainty quantification. Our focus in this paper is a common multi-task problem in neuroimaging, where the goal is to understand the relationship between multiple cognitive task scores (or other subject-level assessments) and brain connectome data collected from imaging. We propose a framework for selective inference to address this problem, with the flexibility to: (i) jointly identify the relevant covariates for each task through a sparsity-inducing penalty, and (ii) conduct valid inference in a model based on the estimated sparsity structure. Our framework offers a new conditional procedure for inference, based on a refinement of the selection event that yields a tractable selection-adjusted likelihood. This gives an approximate system of estimating equations for maximum likelihood inference, solvable via a single convex optimization problem, and enables us to efficiently form confidence intervals with approximately the correct coverage. Applied to both simulated data and data from the Adolescent Brain Cognitive Development (ABCD) study, our selective inference methods yield tighter confidence intervals than commonly used alternatives, such as data splitting. We also demonstrate through simulations that multi-task learning with selective inference can more accurately recover true signals than single-task methods.

The trace norm constrained matrix-variate Gaussian process for multitask bipartite ranking

Single-task and multitask sparse Gaussian processes

Scalable Multi-Task Gaussian Process Tensor Regression for Normative Modeling of Structured Variation in Neuroimaging Data

Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processes

BiRank: Towards Ranking on Bipartite Graphs

Spectral Algorithm for Low-rank Multitask Regression

Learning Linear and Nonlinear Low-Rank Structure in Multi-Task Learning

Nonparametric Bayesian Multi-Task Large-margin Classification.

Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors

Time-Varying Transition Matrices with Multi-task Gaussian Processes

Deep Multi-Task Learning via Generalized Tensor Trace Norm

Fast Low-Rank Bayesian Matrix Completion with Hierarchical Gaussian Prior Models

Selective Inference for Sparse Multitask Regression with Applications in Neuroimaging

Multi-task Sparse Gaussian Processes with Improved Multi-task Sparsity Regularization.

Scalable Bayesian Tensor Ring Factorization for Multiway Data Analysis

Low-rank Bayesian matrix completion via geodesic Hamiltonian Monte Carlo on Stiefel manifolds

Nonparametric Trace Regression in High Dimensions via Sign Series Representation

Nonparametric Bayesian Mixed-effect Model: a Sparse Gaussian Process Approach

Sketching low-rank matrices with a shared column space by convex programming

Nonparametric Bayesian Multi-task Learning with Max-margin Posterior Regularization

General-Purpose Bayesian Tensor Learning With Automatic Rank Determination and Uncertainty Quantification