Abstract:It has previously been shown that generic cortical microcircuit models can perform complex real-time computations on continuous input streams, provided that these computations can be carried out with a rapidly fading memory. We investigate the computational capability of such circuits in the more realistic case where not only readout neurons, but in addition a few neurons within the circuit, have been trained for specific tasks. This is essentially equivalent to the case where the output of trained readout neurons is fed back into the circuit. We show that this new model overcomes the limitation of a rapidly fading memory. In fact, we prove that in the idealized case without noise it can carry out any conceivable digital or analog computation on time-varying inputs. But even with noise, the resulting computational model can perform a large class of biologically relevant real-time computations that require a nonfading memory. We demonstrate these computational implications of feedback both theoretically, and through computer simulations of detailed cortical microcircuit models that are subject to noise and have complex inherent dynamics. We show that the application of simple learning procedures (such as linear regression or perceptron learning) to a few neurons enables such circuits to represent time over behaviorally relevant long time spans, to integrate evidence from incoming spike trains over longer periods of time, and to process new information contained in such spike trains in diverse ways according to the current internal state of the circuit. In particular we show that such generic cortical microcircuits with feedback provide a new model for working memory that is consistent with a large set of biological constraints. Although this article examines primarily the computational role of feedback in circuits of neurons, the mathematical principles on which its analysis is based apply to a variety of dynamical systems. Hence they may also throw new light on the computational role of feedback in other complex biological dynamical systems, such as, for example, genetic regulatory networks.

On the Computational Power of Winner-Take-All

Winner-Take-All as Basic Probabilistic Inference Unit of Neuronal Circuits

Computational Tradeoffs in Biological Neural Networks: Self-Stabilizing Winner-Take-All Networks

A Winner-Take-All Neural Networks of N Linear Threshold Neurons Without Self-Excitatory Connections

Lower Bounds for the Computational Power of Networks of Spiking Neurons

Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks.

A Model for Quantum Stochastic Absorption in Absorbing Disordered Media

A Model of Neural Circuit with Adaption and Nonlinear Connection

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Dynamical Origin for Winner-Take-All Competition in A Biological Network of The Hippocampal Dentate Gyrus

A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition

Winner-Takes-All Mechanism Realized By Memristive Neural Network

Competition Based on Selective Positive-Negative Feedback

Analysis and Design of Winner-Take-All Behavior Based on A Novel Memristive Neural Network

Properties and Performance of Imperfect Dual Neural Network-Based $k$ WTA Networks

A nonlinear model to generate the winner-take-all competition

Versatile networks of simulated spiking neurons displaying winner-take-all behavior

Computational Aspects of Feedback in Neural Circuits

On Algebraic Constructions of Neural Networks with Small Weights

Beyond the circuit architecture : attractor dynamics reveals the mechanism of improved performance in decision-making and working memory