Abstract:Uncovering the underlying biophysical principles of emergent collective computational abilities, such as working memory, in neural circuits is one of the most essential concerns in modern neuroscience. Working memory system is often desired to be robust against noises. Such systems can be highly flexible for adapting environmental demands. How neural circuits reconfigure themselves according to the cognitive task requirement remains unclear. Previous studies explored the robustness and the flexibility in working memory by tracing individual dynamical trajectories in a limited time scale, where the accuracy of the results depends on the volume of the collected statistical data. Inspired by thermodynamics and statistical mechanics in physical systems, we developed a non-equilibrium landscape and flux framework for studying the neural network dynamics. Applying this approach to a biophysically based working memory model, we investigated how changes in the recurrent excitation mediated by slow NMDA receptors within a selective population and mutual inhibition mediated by GABAergic interneurons between populations affect the robustness against noises. This is realized through quantifying the underlying non-equilibrium potential landscape topography and the kinetics of state switching. We found that an optimal compromise for a working memory circuit between the robustness and the flexibility can be achieved through the emergence of an intermediate state between the working memory states. An optimal combination of both increased self-excitation and inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. Furthermore, we found that the enhanced performance in working memory is supported by larger energy consumption. Our approach can facilitate the design of new network structure for cognitive functions with the optimal balance between performance and cost. Our work also provides a new paradigm for exploring the underlying mechanisms of many cognitive functions based on non-equilibrium physics. Author summary Working memory is often associated with stimulus-selective persistent activities in the prefrontal cortex. The nature of a memory storage system indicates that the persistent states should be robust to the noise. However, the brain is inherently noisy. Furthermore, sometimes tilting the balance in favor of the increased flexibility rather than the robustness is required according to the environmental conditions and behavioral task demands. This raises the question of what the precise mechanism is for the interplay between the robustness and flexibility in noisy working memory systems. Applying the non-equilibrium potential landscape and flux approach, we found that the network architecture plays a crucial role in determining the robustness against noises and the flexibility to external stimulus. In contrast to the conventional wisdom that there is a conflict between robustness and flexibility, we found that a combination of both increased self-excitation and mutual inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. The key element of the underlying mechanism for achieving good performance in working memory is the emergence of the new intermediate state. Furthermore, the good performance in working memory is supported by the larger energy expenditure.

Optimizing working memory with heterogeneity of recurrent cortical excitation

Delay-period Activity in Frontal, Parietal, and Occipital Cortex Tracks Noise and Biases in Visual Working Memory

Effect of short-term plasticity on working memory

Non-equilibrium landscape and flux reveal the stability-flexibility-energy tradeoff in working memory

Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model

Network mechanisms of working memory: the role of neuronal nonlinearities

Neurocomputational models of working memory

A Spiking Working Memory Model Based on Hebbian Short-Term Potentiation

Heterogeneous Forgetting Rates and Greedy Allocation in Slot-Based Memory Networks Promotes Signal Retention

From Distributed Resources to Limited Slots in Multiple-Item Working Memory: A Spiking Network Model with Normalization

Slow manifolds within network dynamics encode working memory efficiently and robustly

Exact neural mass model for synaptic-based working memory

Intermittent rate coding and cue-specific ensembles support working memory

Memory Retention in Pyramidal Neurons: a Unified Model of Energy-Based Homo and Heterosynaptic Plasticity with Homeostasis

Attention and Working Memory: a Dynamical Model of Neuronal Activity in the Prefrontal Cortex

Energy Consumption Optimization, Response Time Differences and Indicators in Cortical Working Memory Revealed by Nonequilibrium

Neural population dynamics of human working memory

Trial-to-trial variability of spiking delay activity in prefrontal cortex constrains burst-coding models of working memory

Efficient Reinforcement Learning of a Reservoir Network Model of Parametric Working Memory Achieved with a Cluster Population Winner-Take-all Readout Mechanism.

Distinct excitatory and inhibitory bump wandering in a stochastic neural field

A working memory model based on recurrent neural networks using reinforcement learning