Abstract:Echo state networks (ESNs), belonging to the family of recurrent neural networks (RNNs), are suitable for addressing complex nonlinear tasks due to their rich dynamic characteristics and easy implementation. The reservoir of the ESN is composed of a large number of sparsely connected neurons with randomly generated weight matrices. How to set the structural parameters of the ESN becomes a difficult problem in practical applications. Traditionally, the design of the parameters of the ESN structure is performed manually. The manual adjustment of the ESN parameters is not convenient since it is an extremely challenging and time-consuming task. This paper proposes an ensemble of five particle swarm optimization (PSO) strategies to design the structure of ESN and then reduce the manual intervention in the design process. An adaptive selection mechanism is used for each particle in the evolution to select a strategy from the strategy candidate pool for evolution. In addition, leaky integration neurons are used as reservoir internal neurons, which are added within the adaptive mechanism for optimization. The root mean squared error (RMSE) is adopted as the evaluation criterion. The experimental results on Mackey–Glass time series benchmark dataset show that the proposed method outperforms other traditional evolutionary methods. Furthermore, experimental results on electrocardiogram dataset show that the proposed method on the ensemble of PSO displays an excellent performance on real-world problems.

K-order Echo-Type Spiking Neural P Systems for Time Series Forecasting

Echo spiking neural P systems

A deep echo-like spiking neural P systems for time series prediction

A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Nonlinear Spiking Neural Systems With Autapses for Predicting Chaotic Time Series

Echo State Network Based on Phase Space Reconstruction: El Niño 3 Index Forecasting

A Prediction Model Based on Gated Nonlinear Spiking Neural Systems

Gated Spiking Neural P Systems for Time Series Forecasting

Short-Term Photovoltaic Power Prediction Using Nonlinear Spiking Neural P Systems

LSTM-SNP: A long short-term memory model inspired from spiking neural P systems

Long-Short Term Echo State Network for Time Series Prediction

Reservoir computing models based on spiking neural P systems for time series classification

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

Time series classification models based on nonlinear spiking neural P systems

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

Multivariate time series forecasting method based on nonlinear spiking neural P systems and non-subsampled shearlet transform

Time series prediction using deep echo state networks

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Chaotic Time Series Prediction Using a Novel Echo State Network Model with Input Reconstruction, Bayesian Ridge Regression and Independent Component Analysis

Methodology based on spiking neural networks for univariate time-series forecasting