Abstract:Recently, online learning algorithms in machine learning have been imposed much attention. As a typical family, kernel adaptive filtering algorithms receive particular interest due to their sequential learning-based features. However, the kernel least mean square (KLMS) algorithm is not suitable for nonlinear tasks corrupted by non-Gaussian noise, especially impulsive noise. This is because the derivation of the KLMS algorithm is on the basis of the mean square error (MSE) criterion which only captures information of second-order statistics. In this paper, motivated by tanh function, we develop its generalized variant by introducing a scale factor for better representation capability; then we incorporate kernel adaptive filter with the generalized tanh function to propose a robust sequential learning algorithm. Based on establishing the energy conservation relation, we derive a sufficient condition for ensuring the algorithm convergence. In addition, to perform the steady-state excess mean square error (EMSE) analysis, we use the pre-tuned dictionary strategy to model the unknown nonlinear system in form of a finite-order combination; by Taylor expansion, we arrive at a closed-form solution for predicting the steady-state behavior. To further improve the algorithm performance, we design an optimization scheme for scale factor. Simulations for nonlinear time series prediction show that the designed schemes yield better performance than some state-of-art algorithms. The steady-state EMSE analysis is validated to provide accurate prediction results.

The Nearest-Instance-Centroid-Estimation Kernel Recursive Least Squares Algorithms

Kernel Least-Mean Mixed-Norm Algorithm

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Quantized criterion-based kernel recursive least squares adaptive filtering for time series prediction

Kernel Least Mean Square Based on Conjugate Gradient.

Projected Kernel Recursive Least Squares Algorithm

A Reduced Gaussian Kernel Least-Mean-Square Algorithm for Nonlinear Adaptive Signal Processing

Random Fourier Feature Kernel Recursive Least Squares.

A Kernel Least Mean Square Algorithm Based on Randomized Feature Networks

Quantized Kernel Recursive Least Squares Algorithm.

Sparse Kernel Recursive Least Squares Using L1 Regularization and a Fixed-Point Sub-Iteration

Quantized Kernel Least Mean Square Algorithm

Kernel Adaptive Filtering with Maximum Correntropy Criterion

Quantized generalized minimum error entropy for kernel recursive least squares adaptive filtering

Steady-state Mean Square Performance of a Sparsified Kernel Least Mean Square Algorithm.

Kernel Least Mean Square with Adaptive Kernel Size

Distributed Sparse Recursive Least-Squares over Networks

Robust kernel adaptive filtering for nonlinear time series prediction

Self-evolving Kernel Recursive Least Squares Algorithm for Control and Prediction

Kernel robust mixed-norm adaptive filtering

Nonlinear Multiple-Delay Feedback Based Kernel Least Mean Square Algorithm