Abstract:Many regression problems involve not one but several response variables (y's). Often the responses are suspected to share a common underlying structure, in which case it may be advantageous to share information across them; this is known as multitask learning. As a special case, we can use multiple responses to better identify shared predictive features -- a project we might call multitask feature selection. This thesis is organized as follows. Section 1 introduces feature selection for regression, focusing on ell_0 regularization methods and their interpretation within a Minimum Description Length (MDL) framework. Section 2 proposes a novel extension of MDL feature selection to the multitask setting. The approach, called the "Multiple Inclusion Criterion" (MIC), is designed to borrow information across regression tasks by more easily selecting features that are associated with multiple responses. We show in experiments on synthetic and real biological data sets that MIC can reduce prediction error in settings where features are at least partially shared across responses. Section 3 surveys hypothesis testing by regression with a single response, focusing on the parallel between the standard Bonferroni correction and an MDL approach. Mirroring the ideas in Section 2, Section 4 proposes a novel MIC approach to hypothesis testing with multiple responses and shows that on synthetic data with significant sharing of features across responses, MIC sometimes outperforms standard FDR-controlling methods in terms of finding true positives for a given level of false positives. Section 5 concludes.

Multitask Learning Using Partial Least Squares Method

On Multivariate Calibration Problems

Multi-way Partial Least Squares Modeling for Three-Dimensional Fluorescence Spectrometry

Application Of Partial Least Squares Support Vector Machines (Pls-Svm) In Spectroscopy Quantitative Analysis

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

Soft variable selection combining partial least squares and attention mechanism for multivariable calibration

Dynamic Process Calibration Based on Sparse Partial Least Squares

Multitask Multiclass Support Vector Machines: Model and Experiments

Multirate Partial Least Squares for Process Monitoring

Multitask Learning of Vegetation Biochemistry from Hyperspectral Data

Least Absolute Deviations Learning of Multiple Tasks

A Minimum Description Length Approach to Multitask Feature Selection

Multitask Sparse Bayesian Learning with Applications in Structural Health Monitoring

Multitask Multiclass Support Vector Machines

Multi-task learning with application to water quality monitoring

Multitask Deep Learning with Dynamic Task Balancing for Quantum Mechanical Properties Prediction

Multitask Learning Based on Least Squares Support Vector Regression for Stock Forecast

Multitask twin support vector machines

Multitask Classification by Learning the Task Relevance

Learning Multiple Dense Prediction Tasks from Partially Annotated Data

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs