Abstract:When multiple items are held in short-term memory, cues that retrospectively prioritise one item over another (retro-cues) can facilitate subsequent recall. However, the neural and computational underpinnings of this effect are poorly understood. One recent study recorded neural signals in the macaque lateral prefrontal cortex (LPFC) during a retro-cueing task, contrasting delay-period activity before (pre-cue) and after (post-cue) retrocue onset. They reported that in the pre-cue delay, the individual stimuli were maintained in independent subspaces of neural population activity, whereas in the post-cue delay, the prioritised items were rotated into a common subspace, potentially allowing a common readout mechanism. To understand how such representational transitions can be learnt through error minimisation, we trained recurrent neural networks (RNNs) with supervision to perform an equivalent cued-recall task. RNNs were presented with two inputs denoting conjunctive colour-location stimuli, followed by a pre-cue memory delay, a location retrocue, and a post-cue delay. We found that the orthogonal-to-parallel geometry transformation observed in the macaque LPFC emerged naturally in RNNs trained to perform the task. Interestingly, the parallel geometry only developed when the cued information was required to be maintained in short-term memory for several cycles before readout, suggesting that it might confer robustness during maintenance. We extend these findings by analysing the learning dynamics and connectivity patterns of the RNNs, as well as the behaviour of models trained with probabilistic cues, allowing us to make predictions for future studies. Overall, our findings are consistent with recent theoretical accounts which propose that retrocues transform the prioritised memory items into a prospective, action-oriented format. Many real-world scenarios require us to manipulate the contents of memory to guide behaviour. For example, when grocery shopping, initially we might keep all the items from our shopping list in mind (i.e., in our short-term memory). However, once we spot the dairy aisle, we might want to extract, or prioritise, the items from our list that belong to this category. The question of how such prioritisation of memory items is achieved in the brain is a topic of active research. A recent study in monkeys provided evidence that initially, individual memory items are kept from interfering with one another by being encoded by different brain activity patterns. However, following a contextual cue (akin to the dairy aisle sign), the short-term memory representations of the prioritised items are reconfigured into a format that collapses across the irrelevant differences and highlights aspects relevant for action. In this study, we modelled the emergence of these representational changes in an artificial neural network model. Our results help explain how such processes can be learnt from experience and why they might emerge in the biological brain.

A model for integrating elementary neural functions into delayed-response behavior

Attention and Working Memory: a Dynamical Model of Neuronal Activity in the Prefrontal Cortex

Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model

A model of cortical cognitive function using hierarchical interactions of gating matrices in internal agents coding relational representations

A Hierarchical Model of Visual Processing Simulates Neural Mechanisms Underlying Reflexive Attention.

“What” and “Where” in Visual Working Memory: A Computational Neurodynamical Perspective for Integrating fMRI and Single-Neuron Data

A model of the IT-PF network in object working memory which includes balanced persistent activity and tuned inhibition

A recurrent neural network model of prefrontal brain activity during a working memory task

Neurodynamics of the Prefrontal Cortex during Conditional Visuomotor Associations

Attention, Short-Term Memory, and Action Selection: A Unifying Theory

Cortico-subcortical dynamics in primate working memory

A Recurrent Model Of The Interaction Between Prefrontal And Inferotemporal Cortex In Delay Tasks

Network modeling of dynamic brain interactions predicts emergence of neural information that supports human cognitive behavior

A Neural Dynamic Model based on Activation Diffusion and a Micro-Explanation for Cognitive Operations

Persistent neuronal activity in human prefrontal cortex links perception and action

Biomimetic model of corticostriatal micro-assemblies discovers new neural code

A computational model of inhibitory control in frontal cortex and basal ganglia

A working memory model based on recurrent neural networks using reinforcement learning

A computational model of behavioral adaptation to solve the credit assignment problem

Differentiation and Integration of Competing Memories: A Neural Network Model

Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops