Abstract:Support vector machines(SVMs),which are based on the principle of structural risk minimization,are by far the most sophisticated and powerful classifiers available today.Training an SVM classifier is substantially solving a quadratic programming(QP) problem.Among those SVM training algorithms,Sequential Minimal Optimization and Nearest Point Algorithm are of much concern.Platt's Sequential Minimal Optimization algorithm is a fast iterative algorithm which divides the large scale QP problem into a series of small scale QP sub-problems,thus overcoming the difficulties of the original QP problem which needs enormous matrix storage and does expensive matrix operations.The NPA algorithm transforms a particular SVM classification formulation into a problem of calculating the nearest training samples between two closed convex polytopes in the hidden feature space formed by the two training sample sets.DirectSVM is a very simple iterative algorithm for constructing support vector machine classifiers,and it is most intuitive geometrically.The DirectSVM algorithm is based on the proposition that the two closest training points of the opposite class in a training set are support vectors.Other support vectors are found by using the following conjecture: the training point that maximally violates the current hyper-plane is also a support vector.The DirectSVM algorithm under linearly separable cases is as follows: first,the two nearest training samples of the opposite class are found to be the initial support vectors,and the corresponding original classification hyper-plane is obtained based on these two support vectors;then,the training point that maximally violates the current hyper-plane is found to be a new support vector,and the classification hyper-plane is modified accordingly;the support vector set and the hyper-plane are modified iteratively according to the classification,until no sample is more closer to the classification hyper-plane than those support vectors,and the optimal hyper plane is obtained finally.In this paper,the algorithm is tested with several instances,and the limitation of the algorithm is found.The causation of the limitation and the way to appropriately use the algorithm are discussed.The conclusion is that DirectSVM is not always reliable,but it can be used as an algorithm to construct the approximate optimal hyper-plane.It can also be used to search for the candidate support vector sets and to take the support vector sets as new training sample sets which can be trained by using other classical SVM algorithms such as SMO and NPA.

A Novel Fast Support Vector Machine Based on Support Vector Geometry Analysis

Fast Qualitative Analysis of Textile Fiber in Near Infrared Spectroscopy Based on Support Vector Machine

Fast learning algorithm for support vector domain description

Support Vector Machines Based on Information Geometry

Fast incremental learning algorithm of linear support vector machine based on hull vectors

A new improved support vector machine: QGA-SVM

Fast extraction strategy of support vector machines

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

Approximate Approach to Train SVM on Very Large Data Sets

On-line Support Vector Machine Training Algorithm and Its Application

Online support vector machines with vectors sieving method

A Geometric Approach To Train Svm On Very Large Data Sets

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

A Novel Vectors Surgeon Machine Based on Statistical Learning Theory

A geometrical method to improve performance of the support vector machine.

Micro Learning Support Vector Machine for Pattern Classification: A High-Speed Algorithm.

A Novel Algorithm to Train Support Vector Machine Based on Convex Optimization Theory

Investigation on DirectSVM Algorithm for Support Vector Machine

Support Vector Machine Algorithm in Machine Learning

Research of Support Vector Machines

Application of Support Vector Machines to Accelerate the Solution Speed of Metaheuristic Algorithms