Abstract:In the last decade, a considerable research effort has been devoted to developing adaptive algorithms based on kernel functions. One of the main features of these algorithms is that they form a family of universal approximation techniques, solving problems with nonlinearities elegantly. In this paper, we present data-selective adaptive kernel normalized least-mean square (KNLMS) algorithms that can increase their learning rate and reduce their computational complexity. In fact, these methods deal with kernel expansions, creating a growing structure also known as the dictionary, whose size depends on the number of observations and their innovation. The algorithms described herein use an adaptive step-size to accelerate the learning and can offer an excellent tradeoff between convergence speed and steady state, which allows them to solve nonlinear filtering and estimation problems with a large number of parameters without requiring a large computational cost. The data-selective update scheme also limits the number of operations performed and the size of the dictionary created by the kernel expansion, saving computational resources and dealing with one of the major problems of kernel adaptive algorithms. A statistical analysis is carried out along with a computational complexity analysis of the proposed algorithms. Simulations show that the proposed KNLMS algorithms outperform existing algorithms in examples of nonlinear system identification and prediction of a time series originating from a nonlinear difference equation.

Kernel partial least squares for stationary data

Partial least squares for dependent data

Kernel Partial Least Squares is Universally Consistent

Conjugate Gradients for Kernel Machines

Nonlinear Dynamic Process Monitoring Based on Kernel Partial Least Squares

Kernel regression, minimax rates and effective dimensionality: beyond the regular case

Analysis of Least Squares Regularized Regression in Reproducing Kernel Krein Spaces

Kernel-based function learning in dynamic and non stationary environments

Convergence Conditions of Online Regularized Statistical Learning in Reproducing Kernel Hilbert Space With Non-Stationary Data

Kernel Least-Mean Mixed-Norm Algorithm

Optimal learning rates for Kernel Conjugate Gradient regression

Statistical inference in the partial linear models with the inverse gaussian kernel

Stochastic Low-Rank Kernel Learning for Regression

Study of Set-Membership Adaptive Kernel Algorithms

Analysis of Regularized Least-Squares in Reproducing Kernel Kreĭn Spaces

Kernel Least Mean Square Based on Conjugate Gradient.

A Nonstationary Designer Space-Time Kernel

Mean Square Convergence Analysis for Kernel Least Mean Square Algorithm

Asymptotic Distribution for Regression in A Symmetric Periodic Gaussian Kernel Hilbert Space

On Kernel Regression with Data-Dependent Kernels

Study on Kernel Partial Least Squares Based Key Indicator Prediction.