Abstract:Least squares support vector machines (LS-SVMs) express the training in terms of solving a system of linear equations or an equivalent quadratic program (QP) with one linear equality constraint, in contrast to a QP with lower and upper bounds and one linear equality constraint for conventional support vector machines (SVMs). But for large scale problems, the presence of the linear equality constraint impedes the applications of some well developed methods. In this paper, we first eliminate the linear equality constraint of the QP in training LS-SVM and make it an unconstrained one, then propose a fast iterative single data approach with stepsize acceleration to the unconstrained QP. As a result of combining the selection rule of variables with the coordinate descent approach, the proposed approach is superior to the successive over-relaxation (SOR) method. Meanwhile updating only one variable at each iteration makes the proposed approach simpler and more flexible than the sequential minimal optimization (SMO) method. Computational experiment results on several benchmark data sets show that the proposed approach is more efficient than the existing single data approach and the SMO methods.

Least Square Generalized Support Vector Machines for Regression

Least Squares Support Vector Machines Based on Support Vector Degrees

Flatheaded support vector machine for regression

Sparse Least Squares Support Vector Machine for Function Estimation

Weighted Support Vector Machines for Regression and Its Application

Least squares support vector machine based partially linear model identification

A new improved support vector machine: QGA-SVM

Relation Between a Support Vector Machine and the Least Square Method

M-estimator Based Support Vector Machine and Its Application

Least Squares Support Vector Machine Algorithm

Sparse Least Absolute Deviation Support Vector Machine

Boosting the Partial Least Square Algorithm for Regression Modelling

Fuzzy Support Vector Machine For Regression Estimation

Least Squares Support Vector Machines

Asymmetric and robust loss function driven least squares support vector machine

Modeling method of least squares support vector regression based on vector base learning

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

Multi-output least-squares support vector regression machines

An unbiased LSSVM model for classification and regression