Abstract:Highlights•The stochastic gradient support vector machine algorithm is proposed based on the negative gradient search and the recursive identification methods. •Using the multi-innovation identification theory as the optimization strategy to optimize the stochastic gradient support vector machine algorithm, a multi-innovation stochastic gradient support vector machine algorithm is proposed.•In order to improve the performance of the proposed algorithms, introducing the forgetting factor leads to the corresponding forgetting factor recursive algorithms.For the regression problem of support vector machine, the solution processes of the most existing methods use offline datasets, which cannot be realized online. For this problem, this paper presents a new online approach to identify these unknown parameters contained in the support vector machine. A new cost function is constructed by substituting the error term into the standard cost function, which is different from the standard support vector machine, and the gradient descent approach is then used to minimize the newly created loss function, thus proposing a stochastic gradient support vector machine algorithm to estimate the unknown parameters based on the recursive identification methods. Furthermore, to advance the property of the stochastic gradient support vector machine algorithm, a moving data window is used to widen the scalar information into a fixed-length innovation vector, thereby increasing the amount of information used in the parameter estimation based on the multi-innovation identification theory. In addition, the forgetting factor is brought into the proposed algorithms, and the corresponding forgetting factor recursive algorithms are derived. These methods are recursive identification methods, which may be implemented online and are more efficient in terms of computing. Finally, utilizing the MatLab platform, the validity and usefulness of the explored methodologies are proven using several numerical simulation examples.

Performance analysis of coupled multi-innovation stochastic gradient identification method

Multi-innovation stochastic gradient identification method

Gradient information-based strategy for real time optimization and control integration

Identification and model predictive control of LPV models based on LS-SVM for MIMO system

Multi-innovation identification method for time-varying systems

Multivariable CAR-like System Identification with Multi-innovation Gradient and Least Squares Algorithms

Maximum likelihood based multi‐innovation stochastic gradient identification algorithms for bilinear stochastic systems with ARMA noise

Multi‐innovation gradient‐based iterative identification methods for feedback nonlinear systems by using the decomposition technique

Identification of Multi-Innovation Stochastic Gradients with Maximum Likelihood Algorithm Based on Ship Maneuverability and Wave Peak Models

Additional fractional gradient descent identification algorithm based on multi-innovation principle for autoregressive exogenous models

Hierarchical Stochastic Gradient Algorithm and its Performance Analysis for a Class of Bilinear-in-Parameter Systems

A Model Predictive Control Approach with Relevant Identification in Dynamic PLS Framework

Data Filtering-Based Multi-innovation Stochastic Gradient Algorithm for Nonlinear Output Error Autoregressive Systems

A novel multi-innovation gradient support vector machine regression method

Weighted multi‐innovation parameter estimation for a time‐varying Volterra–Hammerstein system with colored noise

Adaptive Multi-Innovation Gradient Identification Algorithms for a Controlled Autoregressive Autoregressive Moving Average Model

Gradient-based Parameter Estimation for a Nonlinear Exponential Autoregressive Time-series Model by Using the Multi-innovation

Hybrid identification method for fractional-order nonlinear systems based on the multi-innovation principle

Identification of Composite Local Linear Weighted State-Space Systems by Orthogonal Gradient Search

Parameter Identification of Permanent Magnet Synchronous Linear Motors Using Multi-Innovation Least Squares Method

Generalized Parameter Estimation Method for Model-Based Real Time Optimization