Abstract:Uncovering the underlying biophysical principles of emergent collective computational abilities, such as working memory, in neural circuits is one of the most essential concerns in modern neuroscience. Working memory system is often desired to be robust against noises. Such systems can be highly flexible for adapting environmental demands. How neural circuits reconfigure themselves according to the cognitive task requirement remains unclear. Previous studies explored the robustness and the flexibility in working memory by tracing individual dynamical trajectories in a limited time scale, where the accuracy of the results depends on the volume of the collected statistical data. Inspired by thermodynamics and statistical mechanics in physical systems, we developed a non-equilibrium landscape and flux framework for studying the neural network dynamics. Applying this approach to a biophysically based working memory model, we investigated how changes in the recurrent excitation mediated by slow NMDA receptors within a selective population and mutual inhibition mediated by GABAergic interneurons between populations affect the robustness against noises. This is realized through quantifying the underlying non-equilibrium potential landscape topography and the kinetics of state switching. We found that an optimal compromise for a working memory circuit between the robustness and the flexibility can be achieved through the emergence of an intermediate state between the working memory states. An optimal combination of both increased self-excitation and inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. Furthermore, we found that the enhanced performance in working memory is supported by larger energy consumption. Our approach can facilitate the design of new network structure for cognitive functions with the optimal balance between performance and cost. Our work also provides a new paradigm for exploring the underlying mechanisms of many cognitive functions based on non-equilibrium physics. Author summary Working memory is often associated with stimulus-selective persistent activities in the prefrontal cortex. The nature of a memory storage system indicates that the persistent states should be robust to the noise. However, the brain is inherently noisy. Furthermore, sometimes tilting the balance in favor of the increased flexibility rather than the robustness is required according to the environmental conditions and behavioral task demands. This raises the question of what the precise mechanism is for the interplay between the robustness and flexibility in noisy working memory systems. Applying the non-equilibrium potential landscape and flux approach, we found that the network architecture plays a crucial role in determining the robustness against noises and the flexibility to external stimulus. In contrast to the conventional wisdom that there is a conflict between robustness and flexibility, we found that a combination of both increased self-excitation and mutual inhibition can enhance the flexibility to external signals without significantly reducing the robustness to the random fluctuations. The key element of the underlying mechanism for achieving good performance in working memory is the emergence of the new intermediate state. Furthermore, the good performance in working memory is supported by the larger energy expenditure.

Outsourcing Memory Through Niche Construction

Constructing stability: optimal learning in noisy ecological niches

Memory and Organizational Evolvability in a Neutral Landscape

Heterogeneous Forgetting Rates and Greedy Allocation in Slot-Based Memory Networks Promotes Signal Retention

Proactive and reactive construction of memory-based preferences

Memory Allocation Mechanisms Underlie Memory Linking Across Time.

Reconciling categorization and memory via environmental statistics

Reflections of the Environment in Memory

Near-term memory in programming: a simulation-based analysis

The Struggle for Existence: Time, Memory and Bloat

Adaptive forgetting speed in working memory

Reinforcement learning when your life depends on it: A neuro-economic theory of learning

Consequences of cognitive offloading: Boosting performance but diminishing memory

Forgetting Leads to Chaos in Attractor Networks

Non-equilibrium landscape and flux reveal the stability-flexibility-energy tradeoff in working memory

Memory and fitness optimization of bacteria under fluctuating environments

Risk-utility tradeoff shapes memory strategies for evolving patterns

A Formal Approach to Modeling the Memory of a Living Organism

Evidence accumulation and change rate inference in dynamic environments

Selective consolidation of learning and memory via recall-gated plasticity