Abstract:Recently, online learning algorithms in machine learning have been imposed much attention. As a typical family, kernel adaptive filtering algorithms receive particular interest due to their sequential learning-based features. However, the kernel least mean square (KLMS) algorithm is not suitable for nonlinear tasks corrupted by non-Gaussian noise, especially impulsive noise. This is because the derivation of the KLMS algorithm is on the basis of the mean square error (MSE) criterion which only captures information of second-order statistics. In this paper, motivated by tanh function, we develop its generalized variant by introducing a scale factor for better representation capability; then we incorporate kernel adaptive filter with the generalized tanh function to propose a robust sequential learning algorithm. Based on establishing the energy conservation relation, we derive a sufficient condition for ensuring the algorithm convergence. In addition, to perform the steady-state excess mean square error (EMSE) analysis, we use the pre-tuned dictionary strategy to model the unknown nonlinear system in form of a finite-order combination; by Taylor expansion, we arrive at a closed-form solution for predicting the steady-state behavior. To further improve the algorithm performance, we design an optimization scheme for scale factor. Simulations for nonlinear time series prediction show that the designed schemes yield better performance than some state-of-art algorithms. The steady-state EMSE analysis is validated to provide accurate prediction results.

Real-Time Financial Data Prediction Using Meta-Cognitive Recurrent Kernel Online Sequential Extreme Learning Machine

Meta-cognitive Recurrent Kernel Online Sequential Extreme Learning Machine with Kernel Adaptive Filter for Concept Drift Handling

Meta-cognitive Recurrent Recursive Kernel OS-ELM for Concept Drift Handling

Handling Concept Drift in Time-Series Data: Meta-cognitive Recurrent Recursive-Kernel OS-ELM

Recurrent Kernel Online Sequential Extreme Learning Machine with Kernel Adaptive Filter for Time Series Prediction.

Online sequential extreme learning machine with kernels for nonstationary time series prediction.

Multiple Steps Time Series Prediction by A Novel Recurrent Kernel Extreme Learning Machine Approach

Online Sequential Reduced Kernel Extreme Learning Machine.

Handling Concept Drift in Financial Time Series Data: Recurrent Xavier On-line Sequential Extreme Learning Machine.

Recurrent Kernel Extreme Reservoir Machine for Time Series Prediction.

Online sequential extreme learning of sparse ridgelet kernel regressor for nonlinear time-series prediction

Incremental Multiple Kernel Extreme Learning Machine and Its Application in Robo-advisors.

A novel error-output recurrent two-layer extreme learning machine for multi-step time series prediction

Kernel Online Sequential ELM Algorithm with Sliding Window Subject to Time-Varying Environments

Time Series Online Prediction Based On Adaptive Dynamic Adjustment Kernel Recursive Least Squares Algorithm

Online chaotic time-series prediction with the derivative-free extended Kalman filter

Kernel General Loss Algorithm Based on Evolving Participatory Learning for Online Time Series Prediction

An Extreme Learning Machine for Unsupervised Online Anomaly Detection in Multivariate Time Series

Online Regularized and Kernelized Extreme Learning Machines with Forgetting Mechanism

Dynamic Prediction of Internet Financial Market Based on Deep Learning.

Robust kernel adaptive filtering for nonlinear time series prediction