Abstract:The multi-task learning support vector machines (SVMs) have recently attracted considerable attention since the conventional single task learning ones usually ignore the relatedness among multiple related tasks and train them separately. Different from the single task learning, the multi-task learning methods can capture the correlation among tasks and achieve an improved performance by training all tasks simultaneously. In this paper, we make two assumptions on the relatedness among tasks. One is that the normal vectors of the related tasks share a certain common parameter value; the other is that the models of the related tasks are close enough and share a common model. Under these assumptions, we propose two multi-task learning methods, named as MTL-aLS-SVM I and MTL-aLS-SVM II respectively, for binary classification by taking full advantages of multi-task learning and the asymmetric least squared loss. MTL-aLS-SVM I seeks for a trade-off between the maximal expectile distance for each task model and the closeness of each task model to the averaged model. MTL-aLS-SVM II can use different kernel functions for different tasks, and it is an extension of the MTL-aLS-SVM I. Both of them can be easily implemented by solving quadratic programming. In addition, we develop their special cases which include L2-SVM based multi-task learning methods (MTL-L2-SVM I and MTL-L2-SVM II) and the least squares SVM (LS-SVM) based multi-task learning methods (MTL-LS-SVM I and MTL-LS-SVM II). Although the MTL-L2-SVM II and MTL-LS-SVM II appear in the form of special cases, they are firstly proposed in this paper. The experimental results show that the proposed methods are very encouraging.

Nonparametric Bayesian Multi-Task Large-margin Classification.

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

A Multi-Class Large Margin Classifier

A Bayesian Network nearest k-labels method for Multi-label classification

Nonparametric Bayesian Multi-task Learning with Max-margin Posterior Regularization

Label-Sensitive Task Grouping by Bayesian Nonparametric Approach for Multi-Task Multi-Label Learning.

Bayesian Max-margin Multi-Task Learning with Data Augmentation.

Nonparametric Bayesian feature selection for multi-task learning

Infinite Latent SVM for Classification and Multi-task Learning.

Task Diversity in Bayesian Federated Learning: Simultaneous Processing of Classification and Regression

Multitask Bregman Clustering

Bayesian Uncertainty for Gradient Aggregation in Multi-Task Learning

A multiscale Bayesian nonparametric framework for partial hierarchical clustering

Learning the Shared Subspace for Multi-task Clustering and Transductive Transfer Classification.

Multi-task learning via robust regularized clustering with non-convex group penalties

Learning Multi-Task Gaussian Process over Heterogeneous Input Domains

A scalable stage-wise approach to large-margin multi-class loss based boosting

Multi-Task Learning Regression via Convex Clustering

Robust Task Grouping with Representative Tasks for Clustered Multi-Task Learning

Robust Unsupervised Multi-task and Transfer Learning on Gaussian Mixture Models

The Als-Svm Based Multi-Task Learning Classifiers