Abstract:In this paper, sparsification techniques aided online prediction algorithms in a reproducing kernel Hilbert space are studied for nonstationary time series. The online prediction algorithms as usual consist of the selection of kernel structure parameters and the kernel weight vector updating. For structure parameters, the kernel dictionary is selected by sparsification techniques with selective online modeling criteria, and the symmetric kernel covariance matrix is intermittently optimized with the covariance matrix adaptation evolution strategy (CMA-ES). This intermittent optimization can not only improve the kernel structure's flexibility by utilizing the cross relatedness of input variables, but also partly alleviate the prediction uncertainty arisen by the kernel dictionary selection for nonstationary time series. In order to sufficiently capture the underlying dynamic characteristics in prediction-error time series, a generalized optimization strategy is designed to sequentially construct the kernel dictionary selection and weight vector updating procedures in multiple kernel connection modes. The generalized optimization strategy is highly flexible and effective, and it is capable of enhancing the ability to adaptively track the changing dynamic characteristics due to nonstationarity. Finally, in the perspective of top-level design, we summarize the information interaction between the network topology in kernel regressors and the optimization of inner model parameters. Numerical simulations demonstrate that the proposed approach has superior prediction performance for nonstationary time series.

A Quantized Kernel Least-mean-square Algorithm Based on Echo State Network for Online Time-series Prediction

Echo State Network Based on Phase Space Reconstruction: El Niño 3 Index Forecasting

Hybrid Regularized Echo State Network for Multivariate Chaotic Time Series Prediction

Robust kernel adaptive filtering for nonlinear time series prediction

Long-Short Term Echo State Network for Time Series Prediction

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

Online chaotic time-series prediction with the derivative-free extended Kalman filter

Generalized Extended Kalman Filter For Prediction Of Chaotic Time-Series With Intermittent Failures

Quantised Kernel Least Mean Square with Desired Signal Smoothing

An Improved Robust Kernel Adaptive Filtering Method for Time-Series Prediction

Quantized criterion-based kernel recursive least squares adaptive filtering for time series prediction

Optimizing Echo State Networks for Enhancing Large Prediction Horizons of Chaotic Time Series

Chaotic Time Series Prediction using Three-Dimensional FOA and Echo State Network

Structure Parameter Optimized Kernel Based Online Prediction With a Generalized Optimization Strategy for Nonstationary Time Series

Time Series Prediction of ESN Based on Chebyshev Mapping and Strongly Connected Topology

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Nonstationary Time Series Prediction Based on Deep Echo State Network Tuned by Bayesian Optimization

Grey Wolf Optimization–Based Deep Echo State Network for Time Series Prediction

On the Optimization of Machine Learning Techniques for Chaotic Time Series Prediction

A Quantum-Inspired Online Spiking Neural Network for Time-Series Predictions

Quantum Kernel-Based Long Short-term Memory for Climate Time-Series Forecasting