Abstract:Uncovering the underlying biophysical principles of emergent collective computational abilities, such as working memory, in neural circuits is one of the most essential concerns in modern neuroscience. Working memory system is often desired to be robust against noises. Such systems can be highly flexible for adapting environmental demands. How neural circuits reconfigure themselves according to the cognitive task requirement remains unclear. Previous studies explored the robustness and the flexibility in working memory by tracing individual dynamical trajectories in a limited time scale, where the accuracy of the results depends on the volume of the collected statistical data. Inspired by thermodynamics and statistical mechanics in physical systems, we developed a non-equilibrium landscape and flux framework for studying the neural network dynamics. Applying this approach to a biophysically based working memory model, we investigated how changes in the recurrent excitation mediated by slow NMDA receptors within a selective population and mutual inhibition mediated by GABAergic interneurons between populations affect the robustness against noises. This is realized through quantifying the underlying non-equilibrium potential landscape topography and the kinetics of state switching. We found that an optimal compromise for a working memory circuit between the robustness and the flexibility can be achieved through the emergence of an intermediate state between the working memory states. An optimal combination of both increased self-excitation and inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. Furthermore, we found that the enhanced performance in working memory is supported by larger energy consumption. Our approach can facilitate the design of new network structure for cognitive functions with the optimal balance between performance and cost. Our work also provides a new paradigm for exploring the underlying mechanisms of many cognitive functions based on non-equilibrium physics. Author summary Working memory is often associated with stimulus-selective persistent activities in the prefrontal cortex. The nature of a memory storage system indicates that the persistent states should be robust to the noise. However, the brain is inherently noisy. Furthermore, sometimes tilting the balance in favor of the increased flexibility rather than the robustness is required according to the environmental conditions and behavioral task demands. This raises the question of what the precise mechanism is for the interplay between the robustness and flexibility in noisy working memory systems. Applying the non-equilibrium potential landscape and flux approach, we found that the network architecture plays a crucial role in determining the robustness against noises and the flexibility to external stimulus. In contrast to the conventional wisdom that there is a conflict between robustness and flexibility, we found that a combination of both increased self-excitation and mutual inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. The key element of the underlying mechanism for achieving good performance in working memory is the emergence of the new intermediate state. Furthermore, the good performance in working memory is supported by the larger energy expenditure.

Homeostatic regulation of memory systems and adaptive decisions

Active Forgetting: Adaptation of Memory by Prefrontal Control

Memory, Decision-Making, and the Ventromedial Prefrontal Cortex (vmPFC): The Roles of Subcallosal and Posterior Orbitofrontal Cortices in Monitoring and Control Processes

Attention and Working Memory: a Dynamical Model of Neuronal Activity in the Prefrontal Cortex

Parallel Contributions of Distinct Human Memory Systems During Probabilistic Learning.

Non-equilibrium landscape and flux reveal the stability-flexibility-energy tradeoff in working memory

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

A Neurocomputational Theory of the Dopaminergic Modulation of Working Memory Functions

The role of prediction and outcomes in adaptive cognitive control

Temporal Prediction Errors Modulate Cingulate–insular Coupling

Behavioral decision-making of mobile robots simulating the memory consolidation mechanism of human brain

Attention, Short-Term Memory, and Action Selection: A Unifying Theory

Optimal metacognitive control of memory recall.

Mistakes were made: neural mechanisms for the adaptive control of action initiation by the medial prefrontal cortex

Building and Breaking the Chain: A Model of Reward Prediction Error Integration and Segmentation of Memory

Multiple Memory Stores and Operant Conditioning: A Rationale for Memory’s Complexity

The Dynamic Causality Brain Network Reflects Whether the Working Memory is Solidified.

Keeping Your Brain in Balance: Homeostatic Regulation of Network Function

The persistence of memory: prior memory responses modulate behavior and brain state engagement

The Brain's Topographical Organization Shapes Dynamic Interaction Patterns That Support Flexible Behavior Based on Rules and Long-Term Knowledge

Neural Mechanism of Long-Term Memory Storage Andmodulation