Abstract:Highlights•The stochastic gradient support vector machine algorithm is proposed based on the negative gradient search and the recursive identification methods. •Using the multi-innovation identification theory as the optimization strategy to optimize the stochastic gradient support vector machine algorithm, a multi-innovation stochastic gradient support vector machine algorithm is proposed.•In order to improve the performance of the proposed algorithms, introducing the forgetting factor leads to the corresponding forgetting factor recursive algorithms.For the regression problem of support vector machine, the solution processes of the most existing methods use offline datasets, which cannot be realized online. For this problem, this paper presents a new online approach to identify these unknown parameters contained in the support vector machine. A new cost function is constructed by substituting the error term into the standard cost function, which is different from the standard support vector machine, and the gradient descent approach is then used to minimize the newly created loss function, thus proposing a stochastic gradient support vector machine algorithm to estimate the unknown parameters based on the recursive identification methods. Furthermore, to advance the property of the stochastic gradient support vector machine algorithm, a moving data window is used to widen the scalar information into a fixed-length innovation vector, thereby increasing the amount of information used in the parameter estimation based on the multi-innovation identification theory. In addition, the forgetting factor is brought into the proposed algorithms, and the corresponding forgetting factor recursive algorithms are derived. These methods are recursive identification methods, which may be implemented online and are more efficient in terms of computing. Finally, utilizing the MatLab platform, the validity and usefulness of the explored methodologies are proven using several numerical simulation examples.

On-line Multi-Output Support Vector Regression and Its Application to Investment Decision

On-line support vector regression with multiple samples

Multi-Output Online Adaptive Least Squares Support Vector Regression Learning

On-line Support Vector Machine Training Algorithm and Its Application

Epsilon-adjustable on-line support vector regression and its training algorithm

A stock selection algorithm hybridizing grey wolf optimizer and support vector regression

A Class of On-Line Portfolio Selection Algorithms Based on Linear Learning.

A novel multi-innovation gradient support vector machine regression method

Automatic optimized support vector regression for financial data prediction

Prediction based mean-value-at-risk portfolio optimization using machine learning regression algorithms for multi-national stock markets

Online Regression Algorithm Based on Boosting

A Two-Stage Multi-View Prediction Method for Investment Strategy

Multi-factor Stock Selection Model Based on Machine Learning

Robust and adaptive algorithms for online portfolio selection

Fast online support vector regression algorithm based on accelerated decremental strategy

Support Vector Regression with Piecewise Loss Function and Its Application in Investment Decision

The Research and Application of a Learning Algorithm of Batch Increment and Online Which Bases on Support Vector Regression

Online Portfolio Selection with Long-Short Term Forecasting

Mean–variance portfolio optimization using machine learning-based stock price prediction

Exponential Gradient with Momentum for Online Portfolio Selection

An Efficient Gradient-Based Model Selection Algorithm for Multi-Output Least-Squares Support Vector Regression Machines.