Abstract:Reservoir computing is a computational paradigm derived from recurrent neural network models. One of its most representative technique is the Echo State Network (ESN), which is usually composed by two salient components: reservoir and readout. The former is responsible by mapping temporal (or sequential) inputs into a high-dimensional space and the latter aims at learning the patterns in such a new space. Despite ESN has attracted a lot of attention nowadays, most works in the literature are focused on the development of additional features to the model, while there is a considerable lack of investigations related to understand and evaluate some of its inherent concepts as well as their relationships. In this paper we address such a limitation by investigating ESN components related to the reservoir structure and readout layer. To be specific, we evaluate regular and small-world network models besides the extensively adopted random one, and also analyze a total of eight classification techniques instead of considering just the few techniques largely adopted in the literature (mostly linear ones). In order to consistently evaluate the alternative ESN methods, we analyzed a wide range of parameters in both reservoir and readout layers through of several experiments with five real-world data sets. The results revealed that some problems can be considerably benefited from some level of organization in the reservoir, such as those provided by regular or small-world network models; and that the non-linear support vector machine classifier achieved the best predictive performance, although it was statistically comparable with the k-nearest neighbors one, which has much smaller time complexity. Interestingly, such findings may make the adoption of ESN methods more efficient from the point of view of embedded systems and large scale problems.

Detection of Generalized Synchronization using Echo State Networks

Regular Echo State Networks

An echo state network with interacting reservoirs for modeling and analysis of nonlinear systems

Entropy-statistical approach to phase-locking detection of pulse oscillations: application for the analysis of biosignal synchronization

Feedback Coupling Induced Synchronization of Neural Networks

(Thesis) Reservoir Computing With Dynamical Systems

An Extended Synchronization Method to Identify Slowly Time-Varying Parameters in Nonlinear Systems

Embedding and approximation theorems for echo state networks

Identifying phase synchronization clusters in spatially extended dynamical systems

Stable Concurrent Synchronization in Dynamic System Networks

Variability of echo state network prediction horizon for partially observed dynamical systems

Event synchronization: A simple and fast method to measure synchronicity and time delay patterns

Synchronization of Machine Learning Oscillators in Complex Networks

Disentangling synchrony from serial dependency in paired event time series

On-line detection of qualitative dynamical changes in nonlinear systems: the resting-oscillation case

Synchronization of Reservoir Computers with Applications to Communications

Delayed self-feedback echo state network for long-term dynamics of hyperchaotic systems

Dynamic learning of synchronization in coupled nonlinear systems

Unsupervised ensembling of multiple software sensors with phase synchronization: a robust approach for electrocardiogram-derived respiration