Abstract:The multi-task learning support vector machines (SVMs) have recently attracted considerable attention since the conventional single task learning ones usually ignore the relatedness among multiple related tasks and train them separately. Different from the single task learning, the multi-task learning methods can capture the correlation among tasks and achieve an improved performance by training all tasks simultaneously. In this paper, we make two assumptions on the relatedness among tasks. One is that the normal vectors of the related tasks share a certain common parameter value; the other is that the models of the related tasks are close enough and share a common model. Under these assumptions, we propose two multi-task learning methods, named as MTL-aLS-SVM I and MTL-aLS-SVM II respectively, for binary classification by taking full advantages of multi-task learning and the asymmetric least squared loss. MTL-aLS-SVM I seeks for a trade-off between the maximal expectile distance for each task model and the closeness of each task model to the averaged model. MTL-aLS-SVM II can use different kernel functions for different tasks, and it is an extension of the MTL-aLS-SVM I. Both of them can be easily implemented by solving quadratic programming. In addition, we develop their special cases which include L2-SVM based multi-task learning methods (MTL-L2-SVM I and MTL-L2-SVM II) and the least squares SVM (LS-SVM) based multi-task learning methods (MTL-LS-SVM I and MTL-LS-SVM II). Although the MTL-L2-SVM II and MTL-LS-SVM II appear in the form of special cases, they are firstly proposed in this paper. The experimental results show that the proposed methods are very encouraging.

Combining multiple statistical classifiers to improve the accuracy of task classification

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

Multiple Classifiers Combination Based on Specialists' FIelds

Combining Multiple Classifiers Based on Statistical Method for Handwritten Chinese Character Recognition

Multi-classifier Combination for Translation Error Detection

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

Combination of Multiple Classifier Using Feature Space Partitioning

A New Kind of Combination Classifier and Its Application in Classification of Remote Sensing Image

A novel weighted combination technique for traffic classification

A Comparison of Multiple Classifier Combinations Using Different Voting-Weights for Remote Sensing Image Classification

Combined Multiple Classifiers Based on TBL Algorithm and Their Application in Question Classification

Text Classification Based On A Combination Of Ontology With Statistical Method

Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition

The Als-Svm Based Multi-Task Learning Classifiers

Multi-domain Sentiment Classification with Classifier Combination

Combining Multiple K-Nearest Neighbor Classifiers Using Different Distance Functions

Combining Different Classifiers in Educational Data Mining

Voting Principle for Combination of Multiple Classifiers

A New Multiple Classifiers Combination Algorithm