Abstract:As a new version of support vector machine (SVM), least squares SVM (LS-SVM) involves equality instead of inequality constraints and works with a least squares cost function. A well-known drawback in the LS-SVM applications is that the sparseness is lost. In this paper, we develop an adaptive pruning algorithm based on the bottom-to-top strategy, which can deal with this drawback. In the proposed algorithm, the incremental and decremental learning procedures are used alternately and a small support vector set, which can cover most of the information in the training set, can be formed adaptively. Using this set, one can construct the final classifier. In general, the number of the elements in the support vector set is much smaller than that in the training set and a sparse solution is obtained. In order to test the efficiency of the proposed algorithm, we apply it to eight UCI datasets and one benchmarking dataset. The experimental results show that the presented algorithm can obtain adaptively the sparse solutions with losing a little generalization performance for the classification problems with no-noises or noises, and its training speed is much faster than sequential minimal optimization algorithm (SMO) for the large-scale classification problems with no-noises.

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

An improved conjugate gradient scheme to the solution of least squares SVM

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

A new improved support vector machine: QGA-SVM

An Incremental Updating Method for Support Vector Machines

An Improved Ls-Svm Based on Ssor-Pcg

A New Weighted Least Squares Support Vector Machines and Its Sequential Minimal Optimization Algorithm

Incremental algorithm for regression least-squares support vector machines

Improved Sparse Least-Squares Support Vector Machine Classifiers.

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

An improved least squares Twin Support Vector Machine

Dynamic least squares support vector machine

Least squares support vector machine classifiers: a large scale algorithm

An Improved LSSVM Regression Algorithm

Least Square Generalized Support Vector Machines for Regression

The application of least squares support vector machine for classification

Least Squares Support Vector Machine Algorithm

Adaptive Pruning Algorithm for Least Squares Support Vector Machine Classifier

Least Squares Support Vector Machine Regression With Additional Constrains

Linear support vector machine regression models under different criteria