Abstract:Time-series prediction is a popular application that relies on the collection of historical data via sensors, which is then leveraged by predictive models to forecast future values or trends. As an important online predictive model, kernel adaptive filtering (KAF) has attracted much attention over the past decade. The traditional kernel least-mean square (KLMS) is derived based on minimizing the mean square error (MSE) criterion, which inevitably suffers from performance deterioration for nonlinear regression tasks corrupted by non-Gaussian noise. To this end, we, in this article, propose a novel robust KAF algorithm, namely a robust variable step-size kernel normalized LMS (RVSS-KNLMS) algorithm. The fundamental idea of our design is to prevent large outliers from perturbing the model training by limiting the energy of the weight update within a dynamic threshold. By establishing the energy conservation relation, we perform a rigorous analysis of the mean square convergence properties of the proposed algorithm. This analysis allows us to derive a sufficient condition for determining the appropriate step size. In addition, with the pretuned dictionary strategy that serves to simplify the nonlinear system model, we investigate the steady-state excess MSE (EMSE) of the proposed algorithm and arrive at a closed-form solution for prediction. Simulations on synthetic data and real-world data have confirmed the advantages of RVSS-KNLMS. Moreover, the theoretical steady-state analysis has been validated to provide good prediction results.

Kernel Recursive Least Squares with Multiple Feedback and Its Convergence Analysis

Kernel Least Mean Square with Single Feedback

Random Fourier Features Based Nonlinear Recurrent Kernel Normalized LMS Algorithm with Multiple Feedbacks

Variable learning rates kernel adaptive filter with single feedback.

Nonlinear Multiple-Delay Feedback Based Kernel Least Mean Square Algorithm

Sparse Kernel Recursive Least Squares Using L1 Regularization and a Fixed-Point Sub-Iteration

Self-evolving Kernel Recursive Least Squares Algorithm for Control and Prediction

Convergence Analysis of Kernel LMS Algorithm with Pre-Tuned Dictionary

Nonlinear Adaptive Filtering In Kernel Spaces

A Novel Algorithm of Linear Adaptive Square-Root Kalman Filtering Based on Sage-Husa

Regularized Kernel Recursive Least Square Algoirthm

Kernel Adaptive Filtering Subject to Equality Function Constraints

Kernel Adaptive Filtering with Maximum Correntropy Criterion

Kernel Least Mean Square with Adaptive Kernel Size

Kernel robust mixed-norm adaptive filtering

Fixed-Budget Kernel Recursive Least-Squares

Kernel Adaptive Filtering Over Complex Networks

A Unified Framework of Random Feature KLMS Algorithms and Convergence Analysis

Quantized criterion-based kernel recursive least squares adaptive filtering for time series prediction

A Reduced Gaussian Kernel Least-Mean-Square Algorithm for Nonlinear Adaptive Signal Processing

An Improved Robust Kernel Adaptive Filtering Method for Time-Series Prediction