Abstract:Predicting for long-term dynamics of complex systems from observations is a challenging topic in the field of time series modeling and analysis, and is continually under research. Noteworthily, multi-step prediction requires accurate learning of dynamics and correlations between historical data for predicting future behavior. In this paper, we proposed a modified recurrent neural network named hierarchical delay-memory echo state network (HDESN) for solving the task of multi-step chaotic time series prediction. The HDESN uses multiple reservoirs with delay-memory capabilities, which can simultaneously discover and explore the information of short-term and long-term memory hidden in the historical sequence, and extract the valuable evolution patterns through deep topology and hierarchical processing. Moreover, to ensure high-quality prediction results and reduce the computational burden as much as possible, we further design a phase-space representation strategy which can calculate a compact topology and delay-memory coefficient according to the chaotic characteristics of the data. Compared with other improved ESN-based models, the proposed HDESN does not have a larger memory capacity to capture potential evolution law hidden in the complex system layer by layer, but can also adaptively determine a suitable network architecture to reflect the mapping relations in chaotic phase space. The experimental results on two benchmark chaotic systems and a real-world meteorological dataset demonstrate that the proposed HDESN model obtains satisfactory performance in multi-step chaotic time series prediction.

Delayed Deep Echo State Network and Its Application on Time Series Prediction

Multi-state Delayed Echo State Network with Empirical Wavelet Transform for Time Series Prediction

A Double-Cycle Echo State Network Topology for Time Series Prediction.

Long-Short Term Echo State Network for Time Series Prediction

Hierarchical Delay-Memory Echo State Network: A Model Designed for Multi-Step Chaotic Time Series Prediction.

Echo State Networks with Double-Reservoir for Time-Series Prediction

Researches on Time Series Prediction with Echo State Networks

Deep Echo State Network With Multiple Adaptive Reservoirs for Time Series Prediction

Deep Belief Echo-State Network and Its Application to Time Series Prediction.

Subspace Echo State Network for Multivariate Time Series Prediction

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Dynamical Regularized Echo State Network for Time Series Prediction

Design and Application of Adaptive Sparse Deep Echo State Network

Time Series Prediction Using Time-Series Decomposition and Multi-reservoirs Echo State Network

Sequence Prediction with Different Dimensions Based on Two Novel Deep Echo State Network Models

Time Series Prediction with Incomplete Dataset Based on Deep Bidirectional Echo State Network

A deep echo-like spiking neural P systems for time series prediction

Adaptive Lasso Echo State Network for Time Series Prediction

Analysis of Memory Capacity for Deep Echo State Networks

Memory augmented echo state network for time series prediction

Modeling Data-Driven Sensor with a Novel Deep Echo State Network