Abstract:A least squares support vector machine (LS-SVM) offers performance comparable to that of SVMs for classification and regression. The main limitation of LS-SVM is that it lacks sparsity compared with SVMs, making LS-SVM unsuitable for handling large-scale data due to computation and memory costs. To obtain sparse LS-SVM, several pruning methods based on an iterative strategy were recently proposed but did not consider the quantity constraint on the number of reserved support vectors, as widely used in real-life applications. In this article, a noniterative algorithm is proposed based on the selection of globally representative points (global-representation-based sparse least squares support vector machine, GRS-LSSVM) to improve the performance of sparse LS-SVM. For the first time, we present a model of sparse LS-SVM with a quantity constraint. In solving the optimal solution of the model, we find that using globally representative points to construct the reserved support vector set produces a better solution than other methods. We design an indicator based on point density and point dispersion to evaluate the global representation of points in feature space. Using the indicator, the top globally representative points are selected in one step from all points to construct the reserved support vector set of sparse LS-SVM. After obtaining the set, the decision hyperplane of sparse LS-SVM is directly computed using an algebraic formula. This algorithm only consumes O(N2) in computational complexity and O(N) in memory cost which makes it suitable for large-scale data sets. The experimental results show that the proposed algorithm has higher sparsity, greater stability, and lower computational complexity than the traditional iterative algorithms.

Robust Least Squares Projection Twin SVM and Its Sparse Solution

Robust Least Squares Projection Twin Support Vector Machine and Its Sparse Solution

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

Sparse Algorithm for Robust LSSVM in Primal Space

Feature selection for least squares projection twin support vector machine

Robust support vector machines and their sparse algorithms

Sparse Least Squares Support Vector Machine for Function Estimation

Least squares recursive projection twin support vector machine for classification

Sparse LSSVM in Primal Using Cholesky Factorization for Large-Scale Problems

A Weighted Least Squares Twin Support Vector Machine.

NPrSVM: Nonparallel Sparse Projection Support Vector Machine with Efficient Algorithm

Weighted Least Squares Projection Twin Support Vector Machines With Local Information

Sparse Least Squares Support Vector Machine with L0-norm in Primal Space.

Regularization Feature Selection Projection Twin Support Vector Machine Via Exterior Penalty.

An Improved Robust and Sparse Twin Support Vector Regression Via Linear Programming

An Efficient Twin Projection Support Vector Machine for Regression

Noniterative Sparse LS-SVM Based on Globally Representative Point Selection

Robust Least-Squares Support Vector Machine with Minimization of Mean and Variance of Modeling Error.

Sparse Least Absolute Deviation Support Vector Machine

A New Sparse LSSVM Method Based the Revised LARS

An improved least squares Twin Support Vector Machine