Abstract:Echo state network (ESN) has recently attracted increasing interests because of its superior capability in modeling nonlinear dynamic systems. In the conventional echo state network model, its dynamic reservoir (DR) has a random and sparse topology, which is far from the real biological neural networks from both structural and functional perspectives. We hereby propose three novel types of echo state networks with new dynamic reservoir topologies based on complex network theory, i.e., with a small-world topology, a scale-free topology, and a mixture of small-world and scale-free topologies, respectively. We then analyze the relationship between the dynamic reservoir structure and its prediction capability. We utilize two commonly used time series to evaluate the prediction performance of the three proposed echo state networks and compare them to the conventional model. We also use independent and identically distributed time series to analyze the short-term memory and prediction precision of these echo state networks. Furthermore, we study the ratio of scale-free topology and the small-world topology in the mixed-topology network, and examine its influence on the performance of the echo state networks. Our simulation results show that the proposed echo state network models have better prediction capabilities, a wider spectral radius, but retain almost the same short-term memory capacity as compared to the conventional echo state network model. We also find that the smaller the ratio of the scale-free topology over the small-world topology, the better the memory capacities.

A Double-Cycle Echo State Network Topology for Time Series Prediction.

Echo State Networks with Double-Reservoir for Time-Series Prediction

Long-Short Term Echo State Network for Time Series Prediction

Dynamical Regularized Echo State Network for Time Series Prediction

Delayed Deep Echo State Network and Its Application on Time Series Prediction

Dynamic Memristor Based Cyclic Echo State Network for Time Series Prediction

Error-Driven Chained Multiple-Subnetwork Echo State Network for Time-Series Prediction

The Combination of Circle Topology and Leaky Integrator Neurons Remarkably Improves the Performance of Echo State Network on Time Series Prediction

Design of Polynomial Echo State Networks for Time Series Prediction.

Multivariate Nonlinear Time Series Prediction by Chain-Structure Echo State Network

Multi-state Delayed Echo State Network with Empirical Wavelet Transform for Time Series Prediction

Performance Evaluation of New Echo State Networks Based on Complex Network

Design of Sparse Bayesian Echo State Network for Time Series Prediction

Time Series Prediction of ESN Based on Chebyshev Mapping and Strongly Connected Topology

T-distributed stochastic neighbor embedding echo state network with state matrix dimensionality reduction for time series prediction

Subspace Echo State Network for Multivariate Time Series Prediction

Sequence Prediction with Different Dimensions Based on Two Novel Deep Echo State Network Models

The Architecture of Dynamic Reservoir in the Echo State Network

Time Series Prediction Using Time-Series Decomposition and Multi-reservoirs Echo State Network

Adaptive Lasso Echo State Network for Time Series Prediction

Researches on Time Series Prediction with Echo State Networks