Abstract:Multivariate chaotic time series prediction is a hot research topic, the goal of which is to predict the future of the time series based on past observations. Echo state networks (ESNs) have recently been widely used in time series prediction, but there may be an ill-posed problem for a large number of unknown output weights. To solve this problem, we propose a hybrid regularized ESN, which employs a sparse regression with the L1/2 regularization and the L2 regularization to compute the output weights. The L1/2 penalty shows many attractive properties, such as unbiasedness and sparsity. The L2 penalty presents appealing ability on shrinking the amplitude of the output weights. After the output weights are calculated, the input weights, internal weights, and output weights are fine-tuning by a Hessian-free optimization method-conjugate gradient backpropagation algorithm. The fine-tuning helps to bubble up the input information toward the output layer. Besides, the largest Lyapunov exponent is used to calculate the predictable horizon of a chaotic time series. Experimental results on benchmark and real-world datasets show that our proposed method is superior to other ESN-based models, as sparser, smaller-absolute-value, and more informative output weights are obtained. All of the predictions within the predictable horizon of the proposed model are accurate.

An Effective Prediction Model for Aircraft Chaos Time Series Based on Echo State Networks (ESN)

ESN-based Combination Method for Aero-Engine Condition Prediction

ESN-based Combination Method for Turbine Condition Prediction

Noisy Chaotic Time Series Prediction Based on Wavelet Echo State Network

Time Series Prediction with Input Noise Based on the ESN and the EM and Its Industrial Applications

Prediction for noisy nonlinear time series by echo state network based on dual estimation

Research on Fault Prediction of Airplane Steer Based on Improved Chaotic Neural Networks

Generalized Extended Kalman Filter For Prediction Of Chaotic Time-Series With Intermittent Failures

A New and Better Prediction Model for Chaotic Time Series Based on ESN and PCA

Control of discrete chaotic systems based on echo state network modeling with an adaptive noise canceler

The Application of modified ESN in chaotic time series prediction

Prediction of Chaotic Time Series Based on Emd Method

Chaotic Time Series Prediction using Three-Dimensional FOA and Echo State Network

Hybrid Regularized Echo State Network for Multivariate Chaotic Time Series Prediction

Research on Multivariate Prediction Model Based on Echo State Networks

Adaptive Levenberg-Marquardt Algorithm Based Echo State Network for Chaotic Time Series Prediction

Echo state network based on improved fruit fly optimization algorithm for chaotic time series prediction

Brain-Inspired Spike Echo State Network Dynamics for Aero-Engine Intelligent Fault Prediction

Multistep-Ahead Chaotic Time Series Prediction Based on Hierarchical Echo State Network With Augmented Random Features

A Hybrid of NARX and Moving Average Structures for Exhaust Gas Temperature Prediction of Gas Turbine Engines