Abstract:Least squares support vector machines (LS-SVMs) express the training in terms of solving a system of linear equations or an equivalent quadratic program (QP) with one linear equality constraint, in contrast to a QP with lower and upper bounds and one linear equality constraint for conventional support vector machines (SVMs). But for large scale problems, the presence of the linear equality constraint impedes the applications of some well developed methods. In this paper, we first eliminate the linear equality constraint of the QP in training LS-SVM and make it an unconstrained one, then propose a fast iterative single data approach with stepsize acceleration to the unconstrained QP. As a result of combining the selection rule of variables with the coordinate descent approach, the proposed approach is superior to the successive over-relaxation (SOR) method. Meanwhile updating only one variable at each iteration makes the proposed approach simpler and more flexible than the sequential minimal optimization (SMO) method. Computational experiment results on several benchmark data sets show that the proposed approach is more efficient than the existing single data approach and the SMO methods.

Least Squares Support Vector Machine Regression With Additional Constrains

Least Squares Support Vector Machines Based on Support Vector Degrees

Least squares support vector machine based partially linear model identification

Flatheaded support vector machine for regression

Least Square Generalized Support Vector Machines for Regression

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Using Svm To Model And Control Nonlinear Dynamical Systems

Sparse Least Squares Support Vector Machine for Function Estimation

Modeling method of least squares support vector regression based on vector base learning

Least Squares Support Vector Machine Algorithm

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

Relation Between a Support Vector Machine and the Least Square Method

Fuzzy Support Vector Machine For Regression Estimation

Multi-output least-squares support vector regression machines

Dynamic least squares support vector machine

Linear Support Vector Regression with Linear Constraints

Sparse Least Absolute Deviation Support Vector Machine

An unbiased LSSVM model for classification and regression

Asymmetric and robust loss function driven least squares support vector machine

Least Squares Support Vector Machines