A Simplified Multi-Class Support Vector Machine with Reduced Dual Optimization

Xisheng He,Zhe Wang,Cheng Jin,Yingbin Zheng,Xiangyang Xue
DOI: https://doi.org/10.1016/j.patrec.2011.09.035
IF: 4.757
2011-01-01
Pattern Recognition Letters
Abstract:Support vector machine (SVM) was initially designed for binary classification. To extend SVM to the multi-class scenario, a number of classification models were proposed such as the one by Crammer and Singer (2001). However, the number of variables in Crammer and Singer's dual problem is the product of the number of samples (I) by the number of classes (k), which produces a large computational complexity. This paper presents a simplified multi-class SVM (SimMSVM) that reduces the size of the resulting dual problem from I x k to I by introducing a relaxed classification error bound. The experimental results demonstrate that the proposed SimMSVM approach can greatly speed-up the training process, while maintaining a competitive classification accuracy. (C) 2011 Elsevier B.V. All rights reserved.
What problem does this paper attempt to address?