Abstract:The brain often has to make decisions based on information stored in working memory, but the neural circuitry underlying working memory is not fully understood. Many theoretical efforts have been focused on modeling the persistent delay period activity in the prefrontal areas that is believed to represent working memory. Recent experiments reveal that the delay period activity in the prefrontal cortex is neither static nor homogeneous as previously assumed. Models based on reservoir networks have been proposed to model such a dynamical activity pattern. The connections between neurons within a reservoir are random and do not require explicit tuning. Information storage does not depend on the stable states of the network. However, it is not clear how the encoded information can be retrieved for decision making with a biologically realistic algorithm. We therefore built a reservoir-based neural network to model the neuronal responses of the prefrontal cortex in a somatosensory delayed discrimination task. We first illustrate that the neurons in the reservoir exhibit a heterogeneous and dynamical delay period activity observed in previous experiments. Then we show that a cluster population circuit decodes the information from the reservoir with a winner-take-all mechanism and contributes to the decision making. Finally, we show that the model achieves a good performance rapidly by shaping only the readout with reinforcement learning. Our model reproduces important features of previous behavior and neurophysiology data. We illustrate for the first time how task-specific information stored in a reservoir network can be retrieved with a biologically plausible reinforcement learning training scheme.

Interpretable Graph Reservoir Computing With the Temporal Pattern Attention

Reservoir computing dissection and visualization based on directed network embedding

A Comparative Study of Reservoir Computing for Temporal Signal Processing

A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learning

Multi-functional reservoir computing

Hierarchical architectures in reservoir computing systems

Application of Reservoir Computing Based on a 2D Hyperchaotic Discrete Memristive Map in Efficient Temporal Signal Processing.

A Developmental Approach to Structural Self-Organization in Reservoir Computing

Catch-22s of reservoir computing

A systematic exploration of reservoir computing for forecasting complex spatiotemporal dynamics

Embedding Theory of Reservoir Computing and Reducing Reservoir Network Using Time Delays

Interpretable Design of Reservoir Computing Networks Using Realization Theory

Analysis and Fully Memristor-based Reservoir Computing for Temporal Data Classification

Dynamic Memristor-based Reservoir Computing for High-Efficiency Spatiotemporal Signal Processing

Learning reservoir dynamics with temporal self-modulation

Dynamical Analysis of Reservoir Computing: From Single to Few Nodes

Self-organizing Reservoir Computing Based on Spiking-Timing Dependent Plasticity and Intrinsic Plasticity Mechanisms

Efficient Reinforcement Learning of a Reservoir Network Model of Parametric Working Memory Achieved with a Cluster Population Winner-Take-all Readout Mechanism.

A Feature-Recombinant Asynchronous Deep Reservoir Computing for Modeling Time Series Data

Reservoir Computing with Diverse Timescales for Prediction of Multiscale Dynamics

Hybridizing Traditional and Next-Generation Reservoir Computing to Accurately and Efficiently Forecast Dynamical Systems