Abstract:Least squares support vector machines (LS-SVMs) express the training in terms of solving a system of linear equations or an equivalent quadratic program (QP) with one linear equality constraint, in contrast to a QP with lower and upper bounds and one linear equality constraint for conventional support vector machines (SVMs). But for large scale problems, the presence of the linear equality constraint impedes the applications of some well developed methods. In this paper, we first eliminate the linear equality constraint of the QP in training LS-SVM and make it an unconstrained one, then propose a fast iterative single data approach with stepsize acceleration to the unconstrained QP. As a result of combining the selection rule of variables with the coordinate descent approach, the proposed approach is superior to the successive over-relaxation (SOR) method. Meanwhile updating only one variable at each iteration makes the proposed approach simpler and more flexible than the sequential minimal optimization (SMO) method. Computational experiment results on several benchmark data sets show that the proposed approach is more efficient than the existing single data approach and the SMO methods.

Relation Between a Support Vector Machine and the Least Square Method

Least Squares Support Vector Machines Based on Support Vector Degrees

Least Square Generalized Support Vector Machines for Regression

Novel Linear Search for Support Vector Machine Parameter Selection

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Least squares support vector machine based partially linear model identification

Weighted Support Vector Machines for Regression and Its Application

Least Squares Support Vector Machine Algorithm

Sparse Least Absolute Deviation Support Vector Machine

M-estimator Based Support Vector Machine and Its Application

Sparse Least Squares Support Vector Machine for Function Estimation

Modeling method of least squares support vector regression based on vector base learning

Asymmetric and robust loss function driven least squares support vector machine

Asymmetric Least Squares Support Vector Machine Classifiers

Minimal Support Vector Machine

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

Least Squares Support Vector Machines

Robust Support Vector Machine Using Least Median Loss Penalty

Dynamic least squares support vector machine

Volumetric Error Prediction and Compensation of NC Machine Tool Based on Least Square Support Vector Machine