Abstract:Echo state networks (ESNs), belonging to the family of recurrent neural networks (RNNs), are suitable for addressing complex nonlinear tasks due to their rich dynamic characteristics and easy implementation. The reservoir of the ESN is composed of a large number of sparsely connected neurons with randomly generated weight matrices. How to set the structural parameters of the ESN becomes a difficult problem in practical applications. Traditionally, the design of the parameters of the ESN structure is performed manually. The manual adjustment of the ESN parameters is not convenient since it is an extremely challenging and time-consuming task. This paper proposes an ensemble of five particle swarm optimization (PSO) strategies to design the structure of ESN and then reduce the manual intervention in the design process. An adaptive selection mechanism is used for each particle in the evolution to select a strategy from the strategy candidate pool for evolution. In addition, leaky integration neurons are used as reservoir internal neurons, which are added within the adaptive mechanism for optimization. The root mean squared error (RMSE) is adopted as the evaluation criterion. The experimental results on Mackey–Glass time series benchmark dataset show that the proposed method outperforms other traditional evolutionary methods. Furthermore, experimental results on electrocardiogram dataset show that the proposed method on the ensemble of PSO displays an excellent performance on real-world problems.

Chaotic Time Series Prediction Based on a Novel Robust Echo State Network

Chaotic Time Series Prediction Using a Novel Echo State Network Model with Input Reconstruction, Bayesian Ridge Regression and Independent Component Analysis

Design of Sparse Bayesian Echo State Network for Time Series Prediction

Subspace Echo State Network for Multivariate Time Series Prediction

Hierarchical Echo State Network with Sparse Learning: A Method for Multidimensional Chaotic Time Series Prediction.

Reservoir neural state reconstruction and chaotic time series prediction

Robust Neural Predictor for Noisy Chaotic Time Series Prediction

Echo State Network Based on L0 Norm Regularization for Chaotic Time Series Prediction.

Shared reservoir modular echo state networks for chaotic time series prediction

Long-Short Term Echo State Network for Time Series Prediction

L1/2 Norm Regularized Echo State Network for Chaotic Time Series Prediction.

Hybrid Regularized Echo State Network for Multivariate Chaotic Time Series Prediction

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

Predicting Chaotic Time Series and Replicating Chaotic Attractors Based on Two Novel Echo State Network Models

Echo State Networks with Double-Reservoir for Time-Series Prediction

Multiple Clusters Echo State Network for Chaotic Time Series Prediction

Time series prediction using deep echo state networks

Multi-steps prediction of chaotic time series based on echo state network

Optimizing Echo State Networks for Enhancing Large Prediction Horizons of Chaotic Time Series

Adaptive Levenberg-Marquardt Algorithm Based Echo State Network for Chaotic Time Series Prediction

Evolutionary Echo State Network for Long-Term Time Series Prediction: on the Edge of Chaos