Abstract:A sparse approximation algorithm based on projection is presented in this paper in order to overcome the limitation of the non-sparsity of least squares support vector machines (LS-SVM). The new inputs are projected into the subspace spanned by previous basis vectors (BV) and those inputs whose squared distance from the subspace is higher than a threshold are added in the BV set, while others are rejected. This consequently results in the sparse approximation. In addition, a recursive approach to deleting an exiting vector in the BV set is proposed. Then the online LS-SVM, sparse approximation and BV removal are combined to produce the sparse online LS-SVM algorithm that can control the size of memory irrespective of the processed data size. The suggested algorithm is applied in the online modeling of a pH neutralizing process and the isomerization plant of a refinery, respectively. The detailed comparison of computing time and precision is also given between the suggested algorithm and the nonsparse one. The results show that the proposed algorithm greatly improves the sparsity just with little cost of precision.

Modeling method of least squares support vector regression based on vector base learning

A Least Square Support Vector Machine Approach Based on Bvrna-Ga for Modeling Photovoltaic Systems

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

Least Squares Support Vector Machines Based on Support Vector Degrees

Modeling of Isomerization of C-8 Aromatics by Online Least Squares Support Vector Machine

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Recursive Least Squares Support Vector Regression

Modeling Of Neutralizing Process Based On Pruning Fuzzy Least Squares Support Vector Machine

New Predictive Control Algorithms Based on Least Squares Support Vector Machines

Modeling and Prediction Based on Recursive Least Square Support Vector Regression

Sparse Least Squares Support Vector Machine for Function Estimation

M-estimator Based Support Vector Machine and Its Application

Least Squares Support Vector Machine Algorithm

Prediction Method Of Peritoneal Fluid Absorption In Renal Failure Therapy Tbased On Least-Square Support Vector Machine

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Local least squares support vector regression with application to online modeling for batch processes

A Novel Soft Sensor Modeling Approach Based on Least Squares Support Vector Machines

Dynamic least squares support vector machine

Least Squares Support Vector Machines

Sparse Least Absolute Deviation Support Vector Machine

Volumetric Error Prediction and Compensation of NC Machine Tool Based on Least Square Support Vector Machine