Abstract:Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately. Despite the potential of multi-task learning to yield more powerful inference than single-task alternatives, prior work in this area has largely omitted uncertainty quantification. Our focus in this paper is a common multi-task problem in neuroimaging, where the goal is to understand the relationship between multiple cognitive task scores (or other subject-level assessments) and brain connectome data collected from imaging. We propose a framework for selective inference to address this problem, with the flexibility to: (i) jointly identify the relevant covariates for each task through a sparsity-inducing penalty, and (ii) conduct valid inference in a model based on the estimated sparsity structure. Our framework offers a new conditional procedure for inference, based on a refinement of the selection event that yields a tractable selection-adjusted likelihood. This gives an approximate system of estimating equations for maximum likelihood inference, solvable via a single convex optimization problem, and enables us to efficiently form confidence intervals with approximately the correct coverage. Applied to both simulated data and data from the Adolescent Brain Cognitive Development (ABCD) study, our selective inference methods yield tighter confidence intervals than commonly used alternatives, such as data splitting. We also demonstrate through simulations that multi-task learning with selective inference can more accurately recover true signals than single-task methods.

Nonparametric Bayesian feature selection for multi-task learning

Network Traffic Classification Via Non-Convex Multi-Task Feature Learning

Nonparametric Bayesian Multi-Task Large-margin Classification.

Nonparametric Bayesian Multi-task Learning with Max-margin Posterior Regularization

Bayesian learning of feature spaces for multitask regression

Online Weighted Multi-Task Feature Selection

On Multivariate Calibration Problems

Bayesian Max-margin Multi-Task Learning with Data Augmentation.

Feature Selection for Multimedia Analysis by Sharing Information among Multiple Tasks

Label-Sensitive Task Grouping by Bayesian Nonparametric Approach for Multi-Task Multi-Label Learning.

High-dimensional Feature Selection Using Hierarchical Bayesian Logistic Regression with Heavy-tailed Priors

Joint Semi-Supervised Feature Selection and Classification Through Bayesian Approach

Multi-Task Learning with Summary Statistics

Multi-task feature learning by using trace norm regularization

A Minimum Description Length Approach to Multitask Feature Selection

Selective Inference for Sparse Multitask Regression with Applications in Neuroimaging

Fully Bayesian Classification with Heavy-tailed Priors for Selection in High-dimensional Features with Grouping Structure

Simultaneous Bayesian Clustering and Feature Selection Through Student's t Mixtures Model.

Bayesian learning of feature spaces for multitasks problems

Fully Bayesian logistic regression with hyper-LASSO priors for high-dimensional feature selection

Learning from Semantically Dependent Multi-Tasks