Abstract:The task of time series forecasting is to predict the future trend of data based on the collected historical data, providing theoretical and data support for human judgment and decision making. Randomization-based echo state networks (ESNs) are widely used in the research and application field of time series analysis for their simple structure and fast training speed. The core of the ESN is its dynamic reservoir, which the original reservoir are randomly generated and controlled only by parameter sparsity, often performing poorly on complex tasks and affecting the performance of networks. Manual design of the topology of reservoir is difficult, time-consuming and inconvenient to operate, which is not conducive to the development of ESNs. The construction of a suitable reservoir topology for practical application problems to enrich reservoir dynamics is a hot research point for researchers. In this paper, an automatic optimization method is introduced into the topology optimization of ESN (TP-ESN), and the particle swarm optimization algorithm is used to optimize the topological construction of the ESN. The connection structure between the reservoir neurons is first encoded and then iteratively optimized. The optimized structure is decoded and then the reservoir is initialized for ESN training. Prediction results on Mackey–Glass benchmark time series and two electroencephalogram (EEG) datasets demonstrate that TP-ESN method can have better adaptability, stronger prediction ability and stability than several other manually designed ESN reservoir topologies in the case of relatively complex tasks.

A New Method to Construct Complex Echo State Networks

Multiple Clusters Echo State Network for Chaotic Time Series Prediction

Chain-Structure Echo State Network With Stochastic Optimization: Methodology and Application

Performance Evaluation of New Echo State Networks Based on Complex Network

Error-Driven Chained Multiple-Subnetwork Echo State Network for Time-Series Prediction

A Double-Cycle Echo State Network Topology for Time Series Prediction.

Analyzing The State Space Property Of Echo State Networks For Chaotic System Prediction

Short Term Traffic Flow Forecasting Based On Improved Echo State Network

Automatic topology optimization of echo state network based on particle swarm optimization

Optimizing Echo State Networks for Enhancing Large Prediction Horizons of Chaotic Time Series

Effects of connectivity structure of complex echo state network on its prediction performance for nonlinear time series

Time Series Prediction of ESN Based on Chebyshev Mapping and Strongly Connected Topology

Multivariate Nonlinear Time Series Prediction by Chain-Structure Echo State Network

Error-Feedback Three-Phase Optimization to Configurable Convolutional Echo State Network for Time Series Forecasting

Predicting Chaotic Time Series and Replicating Chaotic Attractors Based on Two Novel Echo State Network Models

Adaptive Levenberg-Marquardt Algorithm Based Echo State Network for Chaotic Time Series Prediction

Controlling Chaos In A Neural Network Based On The Phase Space Constraint

Hierarchical Echo State Network with Sparse Learning: A Method for Multidimensional Chaotic Time Series Prediction.

Determining Reservoir Topologies from Short-Term Memory in Echo State Networks.

The Architecture of Dynamic Reservoir in the Echo State Network

The Combination of Circle Topology and Leaky Integrator Neurons Remarkably Improves the Performance of Echo State Network on Time Series Prediction