Abstract:In the echo state networks, both reservoir states and network structure are essential for the performance of reservoir computing. In neuroscience, it has been confirmed that a single neuron can adaptively change its intrinsic excitability to fit various synaptic inputs. This mechanism is called intrinsic plasticity (IP) mechanism in the literature. This adaptive adjustment of neuronal response to external inputs is believed to maximize input-output mutual information. Meanwhile, the existence of multi-clustered structure with small-world-like property in the brain has been strongly supported by many neurophysiological experiments. Thus, it is advisable to consider both the intrinsic plasticity and multi-clustered structure of a reservoir network, rather than a random network with a non-adaptive reservoir response. In this paper, reservoir models with neuronal intrinsic plasticity and multi-clustered structure are investigated. The effects of two types of IP rules on the performance of several computational tasks have been investigated in detail by combining neuronal IP with multi-clustered reservoir structures. The first type is the Triesch’s IP rule, which drives the output activities of neurons to approximate exponential distributions; another is the Li’s IP rule, which generates a Gaussian distribution of neuronal firing. Results show that both the multi-clustered structures and IP rules can improve the computational accuracy of reservoir computing. However, before the application of the IP rules, the enhancement of computational performance for multi-clustered reservoirs is minor. Both IP rules contribute to improvement of the computational performance, where the Li’s IP rule is more advantageous than the Triesch’s IP. The results indicate that the combination of multi-clustered reservoir structures and IP learning can increase the dynamic diversity of reservoir states, especially for the IP’s learning. The adaptive tuning of reservoir states based on IP improves the dynamic complexity of neuronal activity, which helps train output weights. This biologically inspired reservoir model may give insights for the optimization of reservoir computing.

Structure Optimization of Dynamic Reservoir Ensemble Using Genetic Algorithm.

An Optimized Physical Reservoir Computing Through Genetic Algorithm

Self-Evolutionary Reservoir Computer Based on Kuramoto Model

Application of Coarse.grained Genetic Algorithm to Reservoir Operation

Optimization of Reservoir Operation by Using Dynamic Programming-Genetic Algorithm

Global Optimization of Hyper-Parameters in Reservoir Computing

Dynamic Structure-Based Neural Networks Determination Approach Based on the Orthogonal Genetic Algorithm with Quantization

Optimization of a Hydrodynamic Computational Reservoir through Evolution

Reservoir Computing with Both Neuronal Intrinsic Plasticity and Multi-Clustered Structure

A Developmental Approach to Structural Self-Organization in Reservoir Computing

A Parallel Dynamic Programming Algorithm for Multi-Reservoir System Optimization

Stochastic Optimization for Long-Term Operation of Multiple Reservoirs - A New Approach

Reservoir Optimization Scheduling Driven by Knowledge Graphs

Model-Free Control of Dynamical Systems with Deep Reservoir Computing

Surrogate-Assisted Cooperative Co-evolutionary Reservoir Architecture Search for Liquid State Machines

Model-Free Prediction of Chaotic Systems Using High Efficient Next-generation Reservoir Computing

Long-time Reservoir Optimal Operation Based on Progressive Optimality Algorithm——Genetic Algorithm

Optimization of short-term hydropower scheduling with dynamic reservoir capacity based on improved genetic algorithm and parallel computing

Hierarchical Multi-Reservoir Optimization Modeling for Real-World Complexity with Application to the Three Gorges System

Research on the Function of Reservoir Long-term Operation Based on Genetic Algorithms

Efficient Reinforcement Learning of a Reservoir Network Model of Parametric Working Memory Achieved with a Cluster Population Winner-Take-all Readout Mechanism.