Abstract:A new adaptive sparse least squares support vector regression algorithm, referred to as SLSSVR has been introduced for the adaptive modeling of nonstationary systems. Using a sliding window of recent data set of size N to track t he non-stationary characteristics of the incoming data, our adaptive model is initially formulated based on least squares support vector regression with forgetting factor (without bias term). In order to obtain a sparse model in which some parameters are exactly zeros, a l 1 penalty was applied in parameter estimation in the dual problem. Furthermore we exploit the fact that since the associated system/kernel matrix in positive definite, the dual solution of least squares support vector machine without bias term, can be solved iteratively with guaranteed convergence. Furthermore since the models between two consecutive time steps there are (N-1) shared kernels/parameters, the online solution can be obtained efficiently using coordinate descent algorithm in the form of Gauss-Seidel algorithm with minimal number of iterations. This allows a very sparse model per time step to be obtained very efficiently, avoiding expensive matrix inversion. The real stock market dataset and simulated examples have shown that the proposed approaches can lead to superior performances in comparison with the linear recursive least algorithm and a number of online non-linear approaches in terms of modelling performance and model size.

Sparse Least Squares Support Vector Regression for Nonstationary Systems.

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

Flatheaded support vector machine for regression

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Sparse Least Squares Support Vector Machine for Function Estimation

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Local least squares support vector regression with application to online modeling for batch processes

Robust Least Squares Support Vector Machines with Applications to Soft-Sensing

Efficient Sparse Least Squares Support Vector Machines for Regression

Modeling method of least squares support vector regression based on vector base learning

A Non-Biased Form of Least Squares Support Vector Classifier and Its Fast Online Learning

Modeling and Prediction Based on Recursive Least Square Support Vector Regression

Study on the two-stage least square algorithm and its performance for nonstationary stochastic system

Selective Recursive LSSVR and its Applications in Process Modeling

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Dynamic least squares support vector machine

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

Sparse Least Absolute Deviation Support Vector Machine

Sparse Learning for Support Vector Classification

A Sparse Algorithm for Adaptive Pruning Least Square Support Vector Regression Machine Based on Global Representative Point Ranking

An unbiased LSSVM model for classification and regression