Abstract:Recently, online learning algorithms in machine learning have been imposed much attention. As a typical family, kernel adaptive filtering algorithms receive particular interest due to their sequential learning-based features. However, the kernel least mean square (KLMS) algorithm is not suitable for nonlinear tasks corrupted by non-Gaussian noise, especially impulsive noise. This is because the derivation of the KLMS algorithm is on the basis of the mean square error (MSE) criterion which only captures information of second-order statistics. In this paper, motivated by tanh function, we develop its generalized variant by introducing a scale factor for better representation capability; then we incorporate kernel adaptive filter with the generalized tanh function to propose a robust sequential learning algorithm. Based on establishing the energy conservation relation, we derive a sufficient condition for ensuring the algorithm convergence. In addition, to perform the steady-state excess mean square error (EMSE) analysis, we use the pre-tuned dictionary strategy to model the unknown nonlinear system in form of a finite-order combination; by Taylor expansion, we arrive at a closed-form solution for predicting the steady-state behavior. To further improve the algorithm performance, we design an optimization scheme for scale factor. Simulations for nonlinear time series prediction show that the designed schemes yield better performance than some state-of-art algorithms. The steady-state EMSE analysis is validated to provide accurate prediction results.

Kernel Least Mean Square with Single Feedback

Nonlinear Multiple-Delay Feedback Based Kernel Least Mean Square Algorithm

Variable learning rates kernel adaptive filter with single feedback.

Kernel Least Mean Square Based on Conjugate Gradient.

A Reduced Gaussian Kernel Least-Mean-Square Algorithm for Nonlinear Adaptive Signal Processing

Random Fourier Features Based Nonlinear Recurrent Kernel Normalized LMS Algorithm with Multiple Feedbacks

Kernel Least Mean Square with Adaptive Kernel Size

Single Feedback Based Kernel Generalized Maximum Correntropy Adaptive Filtering Algorithm

Kernel Adaptive Filtering with Maximum Correntropy Criterion

Nonlinear Adaptive Filtering In Kernel Spaces

Kernel robust mixed-norm adaptive filtering

A Kernel Least Mean Square Algorithm Based on Randomized Feature Networks

Kernel Least-Mean Mixed-Norm Algorithm

Study of Set-Membership Adaptive Kernel Algorithms

Kernel Online Learning Algorithm with Scale Adaptation.

An Improved Robust Kernel Adaptive Filtering Method for Time-Series Prediction

Robust kernel adaptive filtering for nonlinear time series prediction

Kernel Adaptive Filtering Subject to Equality Function Constraints

Sparse Kernel Recursive Least Squares Using L1 Regularization and a Fixed-Point Sub-Iteration

Self-evolving Kernel Recursive Least Squares Algorithm for Control and Prediction

Steady-state Mean Square Performance of a Sparsified Kernel Least Mean Square Algorithm.