Abstract:Uncovering the underlying biophysical principles of emergent collective computational abilities, such as working memory, in neural circuits is one of the most essential concerns in modern neuroscience. Working memory system is often desired to be robust against noises. Such systems can be highly flexible for adapting environmental demands. How neural circuits reconfigure themselves according to the cognitive task requirement remains unclear. Previous studies explored the robustness and the flexibility in working memory by tracing individual dynamical trajectories in a limited time scale, where the accuracy of the results depends on the volume of the collected statistical data. Inspired by thermodynamics and statistical mechanics in physical systems, we developed a non-equilibrium landscape and flux framework for studying the neural network dynamics. Applying this approach to a biophysically based working memory model, we investigated how changes in the recurrent excitation mediated by slow NMDA receptors within a selective population and mutual inhibition mediated by GABAergic interneurons between populations affect the robustness against noises. This is realized through quantifying the underlying non-equilibrium potential landscape topography and the kinetics of state switching. We found that an optimal compromise for a working memory circuit between the robustness and the flexibility can be achieved through the emergence of an intermediate state between the working memory states. An optimal combination of both increased self-excitation and inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. Furthermore, we found that the enhanced performance in working memory is supported by larger energy consumption. Our approach can facilitate the design of new network structure for cognitive functions with the optimal balance between performance and cost. Our work also provides a new paradigm for exploring the underlying mechanisms of many cognitive functions based on non-equilibrium physics. Author summary Working memory is often associated with stimulus-selective persistent activities in the prefrontal cortex. The nature of a memory storage system indicates that the persistent states should be robust to the noise. However, the brain is inherently noisy. Furthermore, sometimes tilting the balance in favor of the increased flexibility rather than the robustness is required according to the environmental conditions and behavioral task demands. This raises the question of what the precise mechanism is for the interplay between the robustness and flexibility in noisy working memory systems. Applying the non-equilibrium potential landscape and flux approach, we found that the network architecture plays a crucial role in determining the robustness against noises and the flexibility to external stimulus. In contrast to the conventional wisdom that there is a conflict between robustness and flexibility, we found that a combination of both increased self-excitation and mutual inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. The key element of the underlying mechanism for achieving good performance in working memory is the emergence of the new intermediate state. Furthermore, the good performance in working memory is supported by the larger energy expenditure.

Energetics of stochastic BCM type synaptic plasticity and storing of accurate information

Metabolic constraints on synaptic learning and memory

Competitive plasticity to reduce the energetic costs of learning

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Cooperativity, information gain, and energy cost during early LTP in dendritic spines

Co-dependent excitatory and inhibitory plasticity accounts for quick, stable and long-lasting memories in biological networks

Synergies between synaptic and HCN channel plasticity dictates firing rate homeostasis and mutual information transfer in hippocampal model neuron

The interplay between homeostatic synaptic scaling and homeostatic structural plasticity maintains the robust firing rate of neural networks

Theory of Coupled Neuronal-Synaptic Dynamics

Quantifying impacts of short-term plasticity on neuronal information transfer

Learning what matters: Synaptic plasticity with invariance to second-order input correlations

A biochemical description of postsynaptic plasticity-with timescales ranging from milliseconds to seconds

A Unified Computational Model of the Genetic Regulatory Networks Underlying Synaptic, Intrinsic and Homeostatic Plasticity

Synaptic-Like Plasticity in 2D Nanofluidic Memristor from Competitive Bicationic Transport

Synaptic weight dynamics underlying memory consolidation: implications for learning rules, circuit organization, and circuit function

Non-equilibrium landscape and flux reveal the stability-flexibility-energy tradeoff in working memory

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

A framework for studying synaptic plasticity with neural spike train data

Memory-Efficient Synaptic Connectivity for Spike-Timing- Dependent Plasticity