Abstract:Support vector machines(SVMs),which are based on the principle of structural risk minimization,are by far the most sophisticated and powerful classifiers available today.Training an SVM classifier is substantially solving a quadratic programming(QP) problem.Among those SVM training algorithms,Sequential Minimal Optimization and Nearest Point Algorithm are of much concern.Platt's Sequential Minimal Optimization algorithm is a fast iterative algorithm which divides the large scale QP problem into a series of small scale QP sub-problems,thus overcoming the difficulties of the original QP problem which needs enormous matrix storage and does expensive matrix operations.The NPA algorithm transforms a particular SVM classification formulation into a problem of calculating the nearest training samples between two closed convex polytopes in the hidden feature space formed by the two training sample sets.DirectSVM is a very simple iterative algorithm for constructing support vector machine classifiers,and it is most intuitive geometrically.The DirectSVM algorithm is based on the proposition that the two closest training points of the opposite class in a training set are support vectors.Other support vectors are found by using the following conjecture: the training point that maximally violates the current hyper-plane is also a support vector.The DirectSVM algorithm under linearly separable cases is as follows: first,the two nearest training samples of the opposite class are found to be the initial support vectors,and the corresponding original classification hyper-plane is obtained based on these two support vectors;then,the training point that maximally violates the current hyper-plane is found to be a new support vector,and the classification hyper-plane is modified accordingly;the support vector set and the hyper-plane are modified iteratively according to the classification,until no sample is more closer to the classification hyper-plane than those support vectors,and the optimal hyper plane is obtained finally.In this paper,the algorithm is tested with several instances,and the limitation of the algorithm is found.The causation of the limitation and the way to appropriately use the algorithm are discussed.The conclusion is that DirectSVM is not always reliable,but it can be used as an algorithm to construct the approximate optimal hyper-plane.It can also be used to search for the candidate support vector sets and to take the support vector sets as new training sample sets which can be trained by using other classical SVM algorithms such as SMO and NPA.

Training support vector data descriptors using converging linear particle swarm optimization

Shape from Shading Based on Support Vector Regression Algorithm

An On-Line Learning Approach with Support Vector Dormain Classifier

Enhancing Particle Swarm Optimization via probabilistic models

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

Automated Design of Machine Vision Lens Based on the Combination of Particle Swarm Optimization and Damped Least Squares

Acceleration of Subspace Learning Machine via Particle Swarm Optimization and Parallel Processing

Particle Swarm Optimization with Double Learning Patterns

A Novel Hybrid Method of Parameters Tuning in Support Vector Regression for Reliability Prediction: Particle Swarm Optimization Combined With Analytical Selection

A Rapid Particle Swarm Optimization Algorithm with Convergence Analysis

Superiority combination learning distributed particle swarm optimization for large-scale optimization

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

DCWPSO: particle swarm optimization with dynamic inertia weight updating and enhanced learning strategies

Investigation on DirectSVM Algorithm for Support Vector Machine

Particle Swarm Optimization With Local Search

Dynamic multi-swarm particle swarm optimizer with cooperative learning strategy

Robust Support Vector Data Description with Truncated Loss Function for Outliers Depression