Abstract:Echo state networks (ESNs), belonging to the family of recurrent neural networks (RNNs), are suitable for addressing complex nonlinear tasks due to their rich dynamic characteristics and easy implementation. The reservoir of the ESN is composed of a large number of sparsely connected neurons with randomly generated weight matrices. How to set the structural parameters of the ESN becomes a difficult problem in practical applications. Traditionally, the design of the parameters of the ESN structure is performed manually. The manual adjustment of the ESN parameters is not convenient since it is an extremely challenging and time-consuming task. This paper proposes an ensemble of five particle swarm optimization (PSO) strategies to design the structure of ESN and then reduce the manual intervention in the design process. An adaptive selection mechanism is used for each particle in the evolution to select a strategy from the strategy candidate pool for evolution. In addition, leaky integration neurons are used as reservoir internal neurons, which are added within the adaptive mechanism for optimization. The root mean squared error (RMSE) is adopted as the evaluation criterion. The experimental results on Mackey–Glass time series benchmark dataset show that the proposed method outperforms other traditional evolutionary methods. Furthermore, experimental results on electrocardiogram dataset show that the proposed method on the ensemble of PSO displays an excellent performance on real-world problems.

A deep echo-like spiking neural P systems for time series prediction

Echo spiking neural P systems

Echo State Network Based on Phase Space Reconstruction: El Niño 3 Index Forecasting

Long-Short Term Echo State Network for Time Series Prediction

Deep Echo State Network With Multiple Adaptive Reservoirs for Time Series Prediction

Time series prediction using deep echo state networks

Nonstationary Time Series Prediction Based on Deep Echo State Network Tuned by Bayesian Optimization

Design and Application of Adaptive Sparse Deep Echo State Network

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

Grey Wolf Optimization–Based Deep Echo State Network for Time Series Prediction

Self-organizing deep belief modular echo state network for time series prediction

Analysis of Wide and Deep Echo State Networks for Multiscale Spatiotemporal Time Series Forecasting

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Impact of time-history terms on reservoir dynamics and prediction accuracy in echo state networks

Feature-Based Echo-State Networks: A Step Towards Interpretability and Minimalism in Reservoir Computer

Semi-supervised Echo State Network with Partial Correlation Pruning for Time-Series Variables Prediction in Industrial Processes

A novel time series prediction method based on pooling compressed sensing echo state network and its application in stock market

Chaotic Time Series Prediction Using a Novel Echo State Network Model with Input Reconstruction, Bayesian Ridge Regression and Independent Component Analysis

Optimizing Echo State Networks for Enhancing Large Prediction Horizons of Chaotic Time Series

Spiking Deep Residual Networks.

Brain-Inspired Spike Echo State Network Dynamics for Aero-Engine Intelligent Fault Prediction