Abstract:Recently, online learning algorithms in machine learning have been imposed much attention. As a typical family, kernel adaptive filtering algorithms receive particular interest due to their sequential learning-based features. However, the kernel least mean square (KLMS) algorithm is not suitable for nonlinear tasks corrupted by non-Gaussian noise, especially impulsive noise. This is because the derivation of the KLMS algorithm is on the basis of the mean square error (MSE) criterion which only captures information of second-order statistics. In this paper, motivated by tanh function, we develop its generalized variant by introducing a scale factor for better representation capability; then we incorporate kernel adaptive filter with the generalized tanh function to propose a robust sequential learning algorithm. Based on establishing the energy conservation relation, we derive a sufficient condition for ensuring the algorithm convergence. In addition, to perform the steady-state excess mean square error (EMSE) analysis, we use the pre-tuned dictionary strategy to model the unknown nonlinear system in form of a finite-order combination; by Taylor expansion, we arrive at a closed-form solution for predicting the steady-state behavior. To further improve the algorithm performance, we design an optimization scheme for scale factor. Simulations for nonlinear time series prediction show that the designed schemes yield better performance than some state-of-art algorithms. The steady-state EMSE analysis is validated to provide accurate prediction results.

Transient Performance Analysis of Zero-Attracting Gaussian Kernel LMS Algorithm with Pre-Tuned Dictionary.

Transient performance analysis of zero-attracting LMS

Performance Analysis of L-0-Lms with Gaussian Input Signal

Kernel Least Mean Square Based on Conjugate Gradient.

Adaptive Algorithm for Sparse System Identification:Zero-Attracting LMS

A Reduced Gaussian Kernel Least-Mean-Square Algorithm for Nonlinear Adaptive Signal Processing

A Robust Zero-point Attraction LMS Algorithm on Near Sparse System Identification

Steady-state Mean Square Performance of a Sparsified Kernel Least Mean Square Algorithm.

Performance Analysis of the Gradient Comparator LMS Algorithm

Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm

Robust Zero-Point Attraction Least Mean Square Algorithm on Near Sparse System Identification

Sparse LMS for System Identification

Kernel Least-Mean Mixed-Norm Algorithm

Nonlinear Multiple-Delay Feedback Based Kernel Least Mean Square Algorithm

Mean Square Convergence Analysis for Kernel Least Mean Square Algorithm

Online Kernel Learning with a Near Optimal Sparsity Bound

On Initial Convergence Behavior of the Kernel Least Mean Square Algorithm

Robust kernel adaptive filtering for nonlinear time series prediction

Kernel Adaptive Filtering with Maximum Correntropy Criterion

Study of Set-Membership Adaptive Kernel Algorithms

l0 Norm Constraint LMS Algorithm for Sparse System Identification.