Abstract:Reservoir computing, using nonlinear dynamical systems, offers a cost-effective alternative to neural networks for complex tasks involving processing of sequential data, time series modeling, and system identification. Echo state networks (ESNs), a type of reservoir computer, mirror neural networks but simplify training. They apply fixed, random linear transformations to the internal state, followed by nonlinear changes. This process, guided by input signals and linear regression, adapts the system to match target characteristics, reducing computational demands. A potential drawback of ESNs is that the fixed reservoir may not offer the complexity needed for specific problems. While directly altering (training) the internal ESN would reintroduce the computational burden, an indirect modification can be achieved by redirecting some output as input. This feedback can influence the internal reservoir state, yielding ESNs with enhanced complexity suitable for broader challenges. In this paper, we demonstrate that by feeding some component of the reservoir state back into the network through the input, we can drastically improve upon the performance of a given ESN. We rigorously prove that, for any given ESN, feedback will almost always improve the accuracy of the output. For a set of three tasks, each representing different problem classes, we find that with feedback the average error measures are reduced by $30\%-60\%$. Remarkably, feedback provides at least an equivalent performance boost to doubling the initial number of computational nodes, a computationally expensive and technologically challenging alternative. These results demonstrate the broad applicability and substantial usefulness of this feedback scheme.

Optimal echo state network parameters based on behavioural spaces

Performance Optimization Of Echo State Networks Through Principal Neuron Reinforcement

Optimizing the echo state network with a binary particle swarm optimization algorithm

Research for Parameters Optimization of Echo State Network.

Automatic topology optimization of echo state network based on particle swarm optimization

A Hybrid Bayesian Network Structure Learning Algorithm in Equivalence Class Space

Improving greedy local search methods by switching the search space

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction

Optimizing the Echo State Network Based on Mutual Information for Modeling Fed-Batch Bioprocesses

Design of Echo State Network with Multi-Objective Optimization Algorithm and L1 Regularization

Multi-objective Sparse Echo State Network

A Robust Evolutionary Optimisation Approach For Parameterising A Neural Mass Model

Ensemble and Pre-Training Approach for Echo State Network and Extreme Learning Machine Models

Tailoring Echo State Networks for Optimal Learning

Condition Number-based Evolving ESN

A Novel Echo State Network Design Method Based on Differential Evolution Algorithm

Modeling Neural Plasticity in Echo State Networks for Classification and Regression

Short Term Traffic Flow Forecasting Based On Improved Echo State Network

Echo state network based on ant colony algorithm

Modular state space of echo state network

Improving the Performance of Echo State Networks Through Feedback