Abstract:Predicting for long-term dynamics of complex systems from observations is a challenging topic in the field of time series modeling and analysis, and is continually under research. Noteworthily, multi-step prediction requires accurate learning of dynamics and correlations between historical data for predicting future behavior. In this paper, we proposed a modified recurrent neural network named hierarchical delay-memory echo state network (HDESN) for solving the task of multi-step chaotic time series prediction. The HDESN uses multiple reservoirs with delay-memory capabilities, which can simultaneously discover and explore the information of short-term and long-term memory hidden in the historical sequence, and extract the valuable evolution patterns through deep topology and hierarchical processing. Moreover, to ensure high-quality prediction results and reduce the computational burden as much as possible, we further design a phase-space representation strategy which can calculate a compact topology and delay-memory coefficient according to the chaotic characteristics of the data. Compared with other improved ESN-based models, the proposed HDESN does not have a larger memory capacity to capture potential evolution law hidden in the complex system layer by layer, but can also adaptively determine a suitable network architecture to reflect the mapping relations in chaotic phase space. The experimental results on two benchmark chaotic systems and a real-world meteorological dataset demonstrate that the proposed HDESN model obtains satisfactory performance in multi-step chaotic time series prediction.

Error-Driven Chained Multiple-Subnetwork Echo State Network for Time-Series Prediction

Multivariate Nonlinear Time Series Prediction by Chain-Structure Echo State Network

A Double-Cycle Echo State Network Topology for Time Series Prediction.

Chain-Structure Echo State Network With Stochastic Optimization: Methodology and Application

Long-Short Term Echo State Network for Time Series Prediction

Subspace Echo State Network for Multivariate Time Series Prediction

Deep-Chain Echo State Network with Explainable Temporal Dependence for Complex Building Energy Prediction

Hierarchical Echo State Network with Sparse Learning: A Method for Multidimensional Chaotic Time Series Prediction.

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Dynamical Regularized Echo State Network for Time Series Prediction

Spatio-temporal Modeling with Enhanced Flexibility and Robustness of Solar Irradiance Prediction: A Chain-Structure Echo State Network Approach

Design of Sparse Bayesian Echo State Network for Time Series Prediction

Hierarchical Delay-Memory Echo State Network: A Model Designed for Multi-Step Chaotic Time Series Prediction.

Time Series Prediction of ESN Based on Chebyshev Mapping and Strongly Connected Topology

Hybrid Regularized Echo State Network for Multivariate Chaotic Time Series Prediction

Error-Feedback Three-Phase Optimization to Configurable Convolutional Echo State Network for Time Series Forecasting

Echo State Networks with Double-Reservoir for Time-Series Prediction

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

Delayed Deep Echo State Network and Its Application on Time Series Prediction

Adaptive Lasso Echo State Network for Time Series Prediction

Multistep-Ahead Chaotic Time Series Prediction Based on Hierarchical Echo State Network With Augmented Random Features