Abstract:The task of time series forecasting is to predict the future trend of data based on the collected historical data, providing theoretical and data support for human judgment and decision making. Randomization-based echo state networks (ESNs) are widely used in the research and application field of time series analysis for their simple structure and fast training speed. The core of the ESN is its dynamic reservoir, which the original reservoir are randomly generated and controlled only by parameter sparsity, often performing poorly on complex tasks and affecting the performance of networks. Manual design of the topology of reservoir is difficult, time-consuming and inconvenient to operate, which is not conducive to the development of ESNs. The construction of a suitable reservoir topology for practical application problems to enrich reservoir dynamics is a hot research point for researchers. In this paper, an automatic optimization method is introduced into the topology optimization of ESN (TP-ESN), and the particle swarm optimization algorithm is used to optimize the topological construction of the ESN. The connection structure between the reservoir neurons is first encoded and then iteratively optimized. The optimized structure is decoded and then the reservoir is initialized for ESN training. Prediction results on Mackey–Glass benchmark time series and two electroencephalogram (EEG) datasets demonstrate that TP-ESN method can have better adaptability, stronger prediction ability and stability than several other manually designed ESN reservoir topologies in the case of relatively complex tasks.

Time Series Prediction of ESN Based on Chebyshev Mapping and Strongly Connected Topology

A Double-Cycle Echo State Network Topology for Time Series Prediction.

Automatic topology optimization of echo state network based on particle swarm optimization

Hybrid Regularized Echo State Network for Multivariate Chaotic Time Series Prediction

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Optimizing Echo State Networks for Enhancing Large Prediction Horizons of Chaotic Time Series

Hierarchical Echo State Network with Sparse Learning: A Method for Multidimensional Chaotic Time Series Prediction.

The Combination of Circle Topology and Leaky Integrator Neurons Remarkably Improves the Performance of Echo State Network on Time Series Prediction

Multi-state Delayed Echo State Network with Empirical Wavelet Transform for Time Series Prediction

Error-Driven Chained Multiple-Subnetwork Echo State Network for Time-Series Prediction

Design of Polynomial Echo State Networks for Time Series Prediction.

Long-Short Term Echo State Network for Time Series Prediction

A chaotic time series prediction model based on the improved dung beetle optimizer and echo state network

Subspace Echo State Network for Multivariate Time Series Prediction

Nonstationary Time Series Prediction Based on Deep Echo State Network Tuned by Bayesian Optimization

Design of Sparse Bayesian Echo State Network for Time Series Prediction

Dynamical Regularized Echo State Network for Time Series Prediction

Adaptive Levenberg-Marquardt Algorithm Based Echo State Network for Chaotic Time Series Prediction

Reservoir neural state reconstruction and chaotic time series prediction

Sequence Prediction with Different Dimensions Based on Two Novel Deep Echo State Network Models