Abstract:Least squares support vector machine for regression (LSSVR) is an efficient method for function estimation problem. However, its solution is prone to large noise and outliers since it depends on the minimum of the sum of squares error (SSE) on training samples. To tackle this problem, in this paper, a novel regression model termed as recursive robust LSSVR (R^2LSSVR) is proposed to obtain robust estimation for data in the presence of outliers. The idea is to build a regression model in the kernel space based on maximum correntropy criterion and regularization technique. An iterative algorithm derived from half-quadratic optimization is further developed to solve R^2LSSVR with theoretically guaranteed convergence. It also reveals that R^2LSSVR is closely related to the original LSSVR since it essentially solves adaptive weighted LSSVR iteratively. Furthermore, a hyperparameters selection method for R^2LSSVR is presented based on particle swarm optimization (PSO) such that multiple hyperparameters in R^2LSSVR can be estimated effectively for better performance. The feasibility of this method is examined on some simulated and benchmark datasets. The experimental results demonstrate the good robust performance of the proposed method.

Recursive Least-Squares Method with Membership Functions

Recursive Least Squares Support Vector Regression

Modified recursive least squares algorithm with variable parameters and resetting for time-varying system

Improve recursive identification using multi-iteration

Selective Recursive LSSVR and its Applications in Process Modeling

Recursive Least Squares for Censored Regression

Modeling and Prediction Based on Recursive Least Square Support Vector Regression

Research on Identification Process of Nonlinear System Based on an Improved Recursive Least Squares Algorithm

Recursive least squares estimation algorithm applied to a class of linear-in-parameters output error moving average systems.

Recursive Robust Least Squares Support Vector Regression Based on Maximum Correntropy Criterion

Two-dimensional recursive least squares identification based on local polynomial modeling for batch processes.

Recursive Variable Projection Algorithm for a Class of Separable Nonlinear Models

Nonlinear Recursive Partial Least Squares and Its Applications

A Recursive Method of Identification of Hammerstein Model Based on Least Squares Support Vector Machines

Two-dimensional Incremental Recursive Least Squares Identification for Batch Processes

Recursive Least Squares Algorithm for a Nonlinear Additive System with Time Delay

Recursive Least Squares Algorithm for Nonlinear Dual-rate Systems Using Missing-Output Estimation Model

The Recursive Algorithm of Generalized Least Squares Estimation for Linear Model

A High-Order Recursive Quadratic Algorithm for Linear-in-the-Parameter Models

Embedded Point Iteration Based Recursive Algorithm for Online Identification of Nonlinear Regression Models

Modified Recursive Least Squares Algorithm for Sparse System Identification