Abstract:Predicting for long-term dynamics of complex systems from observations is a challenging topic in the field of time series modeling and analysis, and is continually under research. Noteworthily, multi-step prediction requires accurate learning of dynamics and correlations between historical data for predicting future behavior. In this paper, we proposed a modified recurrent neural network named hierarchical delay-memory echo state network (HDESN) for solving the task of multi-step chaotic time series prediction. The HDESN uses multiple reservoirs with delay-memory capabilities, which can simultaneously discover and explore the information of short-term and long-term memory hidden in the historical sequence, and extract the valuable evolution patterns through deep topology and hierarchical processing. Moreover, to ensure high-quality prediction results and reduce the computational burden as much as possible, we further design a phase-space representation strategy which can calculate a compact topology and delay-memory coefficient according to the chaotic characteristics of the data. Compared with other improved ESN-based models, the proposed HDESN does not have a larger memory capacity to capture potential evolution law hidden in the complex system layer by layer, but can also adaptively determine a suitable network architecture to reflect the mapping relations in chaotic phase space. The experimental results on two benchmark chaotic systems and a real-world meteorological dataset demonstrate that the proposed HDESN model obtains satisfactory performance in multi-step chaotic time series prediction.

Deep-Chain Echo State Network with Explainable Temporal Dependence for Complex Building Energy Prediction

Error-Driven Chained Multiple-Subnetwork Echo State Network for Time-Series Prediction

Multivariate Nonlinear Time Series Prediction by Chain-Structure Echo State Network

Multi-state Delayed Echo State Network with Empirical Wavelet Transform for Time Series Prediction

A Double-Cycle Echo State Network Topology for Time Series Prediction.

Design and Application of Adaptive Sparse Deep Echo State Network

Long-Short Term Echo State Network for Time Series Prediction

Hierarchical Delay-Memory Echo State Network: A Model Designed for Multi-Step Chaotic Time Series Prediction.

Delayed Deep Echo State Network and Its Application on Time Series Prediction

Chain-Structure Echo State Network With Stochastic Optimization: Methodology and Application

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Forecasting Energy Consumption and Wind Power Generation Using Deep Echo State Network

Self-organizing deep belief modular echo state network for time series prediction

Spatio-temporal Modeling with Enhanced Flexibility and Robustness of Solar Irradiance Prediction: A Chain-Structure Echo State Network Approach

Sequence Prediction with Different Dimensions Based on Two Novel Deep Echo State Network Models

Multistep-Ahead Chaotic Time Series Prediction Based on Hierarchical Echo State Network With Augmented Random Features

Deep Belief Echo-State Network and Its Application to Time Series Prediction.

Deep Echo State Network with Variable Memory Pattern for Solar Irradiance Prediction

Multiscale Deep Network Based Multistep Prediction of High-Dimensional Time Series from Power Transmission Systems.

Dynamic Memristor Based Cyclic Echo State Network for Time Series Prediction

Hierarchical Echo State Network with Sparse Learning: A Method for Multidimensional Chaotic Time Series Prediction.