Abstract:In this paper, sparsification techniques aided online prediction algorithms in a reproducing kernel Hilbert space are studied for nonstationary time series. The online prediction algorithms as usual consist of the selection of kernel structure parameters and the kernel weight vector updating. For structure parameters, the kernel dictionary is selected by sparsification techniques with selective online modeling criteria, and the symmetric kernel covariance matrix is intermittently optimized with the covariance matrix adaptation evolution strategy (CMA-ES). This intermittent optimization can not only improve the kernel structure's flexibility by utilizing the cross relatedness of input variables, but also partly alleviate the prediction uncertainty arisen by the kernel dictionary selection for nonstationary time series. In order to sufficiently capture the underlying dynamic characteristics in prediction-error time series, a generalized optimization strategy is designed to sequentially construct the kernel dictionary selection and weight vector updating procedures in multiple kernel connection modes. The generalized optimization strategy is highly flexible and effective, and it is capable of enhancing the ability to adaptively track the changing dynamic characteristics due to nonstationarity. Finally, in the perspective of top-level design, we summarize the information interaction between the network topology in kernel regressors and the optimization of inner model parameters. Numerical simulations demonstrate that the proposed approach has superior prediction performance for nonstationary time series.

Optimal Prediction for Kernel-Based Semi-Functional Linear Regression

Optimal Rate for Prediction when Predictor and Response Are Functions

Optimal Prediction of Quantile Functional Linear Regression in Reproducing Kernel Hilbert Spaces

Kernel partial least squares regression for functional nonlinear models

Online Regularized Learning Algorithm for Functional Data

Functional Linear Regression with Mixed Predictors

Strong optimality of kernel functional regression in norms with partial response variables and applications

Statistical Optimality of Divide and Conquer Kernel-based Functional Linear Regression

Optimal Rates for Functional Linear Regression with General Regularization

Optimal linear prediction with functional observations: Why you can use a simple post-dimension reduction estimator

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

Functional Adaptive Huber Linear Regression

Statistical inference for function-on-function linear regression

Kernel-based Estimation for Partially Functional Linear Model: Minimax Rates and Randomized Sketches

Spectral algorithms for functional linear regression

Estimation and Model Selection for Nonparametric Function-on-Function Regression

Dynamic Prediction of Multivariate Functional Data Based on Functional Kernel Partial Least Squares

Structure Parameter Optimized Kernel Based Online Prediction With a Generalized Optimization Strategy for Nonstationary Time Series

Single and multiple index functional regression models with nonparametric link

Nonlinear Multivariate Function-on-function Regression with Variable Selection

A Bayesian approach to functional regression: theory and computation