Abstract:Highlights•The stochastic gradient support vector machine algorithm is proposed based on the negative gradient search and the recursive identification methods. •Using the multi-innovation identification theory as the optimization strategy to optimize the stochastic gradient support vector machine algorithm, a multi-innovation stochastic gradient support vector machine algorithm is proposed.•In order to improve the performance of the proposed algorithms, introducing the forgetting factor leads to the corresponding forgetting factor recursive algorithms.For the regression problem of support vector machine, the solution processes of the most existing methods use offline datasets, which cannot be realized online. For this problem, this paper presents a new online approach to identify these unknown parameters contained in the support vector machine. A new cost function is constructed by substituting the error term into the standard cost function, which is different from the standard support vector machine, and the gradient descent approach is then used to minimize the newly created loss function, thus proposing a stochastic gradient support vector machine algorithm to estimate the unknown parameters based on the recursive identification methods. Furthermore, to advance the property of the stochastic gradient support vector machine algorithm, a moving data window is used to widen the scalar information into a fixed-length innovation vector, thereby increasing the amount of information used in the parameter estimation based on the multi-innovation identification theory. In addition, the forgetting factor is brought into the proposed algorithms, and the corresponding forgetting factor recursive algorithms are derived. These methods are recursive identification methods, which may be implemented online and are more efficient in terms of computing. Finally, utilizing the MatLab platform, the validity and usefulness of the explored methodologies are proven using several numerical simulation examples.

A new time series regression method based on support vector machine plus and genetic algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

A new improved support vector machine: QGA-SVM

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Improved support vector machine for multi-class classification problems

A Least Square Support Vector Machine Approach Based on Bvrna-Ga for Modeling Photovoltaic Systems

Power Transformer Fault Diagnosis Using Svm With Genetic Algorithms Optimization

Multidimensional Time Series Analysis Based on Support Vector Regression and Geostatistics

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

Parameter choosing method of support vector regression for time series prediction

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Fuzzy Support Vector Machine For Regression Estimation

A Multi-SVR Based Fuzzy Modeling Method for Non-Stationary Time Series

A generalized financial time series forecasting model based on automatic feature engineering using genetic algorithms and support vector machine

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Hyper Parameters Selection For Svr Based On Steady-State Genetic Algorithm

Dynamic least squares support vector machine

Online support vector machines with vectors sieving method

A novel multi-innovation gradient support vector machine regression method

SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance