Pre -extracting Support Vector for Support Vector Machine Based on Vector Projection
Qing LI,Li-Cheng JIAO,Wei-Da ZHOU
DOI: https://doi.org/10.3321/j.issn:0254-4164.2005.02.001
2005-01-01
Chinese Journal of Computers
Abstract:Support Vector Machine (SVM), a novel method of the pattern recognition, presents excellent performance in solving the problems with small sample, nonlinear and local minima. However, training a support vector machine (SVM) is equivalent to solving a linearly constrained quadratic programming (QP) problem in a number of variables equal to the number of data points. This optimization problem is known to be challenging when the number of data points exceeds few thousands. Also, it is well known that the ratio of support vectors (SVs) is far low in many practical circumstances. So the method of pre extracting SVs to train classifier becomes a novel task in SVM field. In this paper, on a deep investigation into the principle of SVM and its characteristic, we a new method for pre extracting SVs based on vector projection is introduced, which reduces the training samples greatly and speeds up the SVM learning, while the ability of SVM remains unchanged.