Abstract:The multi-task learning support vector machines (SVMs) have recently attracted considerable attention since the conventional single task learning ones usually ignore the relatedness among multiple related tasks and train them separately. Different from the single task learning, the multi-task learning methods can capture the correlation among tasks and achieve an improved performance by training all tasks simultaneously. In this paper, we make two assumptions on the relatedness among tasks. One is that the normal vectors of the related tasks share a certain common parameter value; the other is that the models of the related tasks are close enough and share a common model. Under these assumptions, we propose two multi-task learning methods, named as MTL-aLS-SVM I and MTL-aLS-SVM II respectively, for binary classification by taking full advantages of multi-task learning and the asymmetric least squared loss. MTL-aLS-SVM I seeks for a trade-off between the maximal expectile distance for each task model and the closeness of each task model to the averaged model. MTL-aLS-SVM II can use different kernel functions for different tasks, and it is an extension of the MTL-aLS-SVM I. Both of them can be easily implemented by solving quadratic programming. In addition, we develop their special cases which include L2-SVM based multi-task learning methods (MTL-L2-SVM I and MTL-L2-SVM II) and the least squares SVM (LS-SVM) based multi-task learning methods (MTL-LS-SVM I and MTL-LS-SVM II). Although the MTL-L2-SVM II and MTL-LS-SVM II appear in the form of special cases, they are firstly proposed in this paper. The experimental results show that the proposed methods are very encouraging.

Multi-task Support Vector Machine with Pinball Loss.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Novel Ramp Loss-Based Multi-Task Twin Support Vector Machine with Multi-Parameter Safe Acceleration

A Novel Twin Support-Vector Machine with Pinball Loss

Multi-task Support Vector Machine Classifier with Generalized Huber Loss

Multi-view universum support vector machines with insensitive pinball loss

Support Vector Machine Classifier with Pinball Loss

A Nonparallel Support Vector Machine with Pinball Loss for Pattern Classification

Support vector machine with truncated pinball loss and its application in pattern recognition

The Als-Svm Based Multi-Task Learning Classifiers

Support Matrix Machine with Pinball Loss for Classification

Multi-task Nonparallel Support Vector Machine for Classification

Twin-parametric Margin Support Vector Machine with Truncated Pinball Loss

A Rough Margin-Based Multi-Task Ν-Twin Support Vector Machine for Pattern Classification.

Twin K -class support vector classification with pinball loss

Maximum margin of twin spheres machine with pinball loss for imbalanced data classification

Sequential minimal optimization for SVM with pinball loss.

Multi-task Least Squares Twin Support Vector Machine for Classification

Improvement over Pinball Loss Support Vector Machine

Multi-task proximal support vector machine

Support Matrix Machine with Truncated Pinball Loss for Classification