Abstract:When multiple items are held in short-term memory, cues that retrospectively prioritise one item over another (retro-cues) can facilitate subsequent recall. However, the neural and computational underpinnings of this effect are poorly understood. One recent study recorded neural signals in the macaque lateral prefrontal cortex (LPFC) during a retro-cueing task, contrasting delay-period activity before (pre-cue) and after (post-cue) retrocue onset. They reported that in the pre-cue delay, the individual stimuli were maintained in independent subspaces of neural population activity, whereas in the post-cue delay, the prioritised items were rotated into a common subspace, potentially allowing a common readout mechanism. To understand how such representational transitions can be learnt through error minimisation, we trained recurrent neural networks (RNNs) with supervision to perform an equivalent cued-recall task. RNNs were presented with two inputs denoting conjunctive colour-location stimuli, followed by a pre-cue memory delay, a location retrocue, and a post-cue delay. We found that the orthogonal-to-parallel geometry transformation observed in the macaque LPFC emerged naturally in RNNs trained to perform the task. Interestingly, the parallel geometry only developed when the cued information was required to be maintained in short-term memory for several cycles before readout, suggesting that it might confer robustness during maintenance. We extend these findings by analysing the learning dynamics and connectivity patterns of the RNNs, as well as the behaviour of models trained with probabilistic cues, allowing us to make predictions for future studies. Overall, our findings are consistent with recent theoretical accounts which propose that retrocues transform the prioritised memory items into a prospective, action-oriented format. Many real-world scenarios require us to manipulate the contents of memory to guide behaviour. For example, when grocery shopping, initially we might keep all the items from our shopping list in mind (i.e., in our short-term memory). However, once we spot the dairy aisle, we might want to extract, or prioritise, the items from our list that belong to this category. The question of how such prioritisation of memory items is achieved in the brain is a topic of active research. A recent study in monkeys provided evidence that initially, individual memory items are kept from interfering with one another by being encoded by different brain activity patterns. However, following a contextual cue (akin to the dairy aisle sign), the short-term memory representations of the prioritised items are reconfigured into a format that collapses across the irrelevant differences and highlights aspects relevant for action. In this study, we modelled the emergence of these representational changes in an artificial neural network model. Our results help explain how such processes can be learnt from experience and why they might emerge in the biological brain.

Recurrent networks endowed with structural priors explain suboptimal animal behavior

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Exploration-exploitation mechanisms in recurrent neural networks and human learners in restless bandit problems

A recurrent neural network framework for flexible and adaptive decision making based on sequence learning

Spiking Recurrent Neural Networks Represent Task-Relevant Neural Sequences in Rule-Dependent Computation

Encoding priors in the brain: a reinforcement learning model for mouse decision making

Prediction Of Rat Behavior Outcomes In Memory Tasks Using Functional Connections Among Neurons

A multi-region recurrent circuit for evidence accumulation in rats

A recurrent neural network model of prefrontal brain activity during a working memory task

Neuron-level prediction and noise can implement flexible reward-seeking behavior

Discovering Cognitive Strategies with Tiny Recurrent Neural Networks

Neural dynamics of reversal learning in the prefrontal cortex and recurrent neural networks

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

One Step Back, Two Steps Forward: Interference and Learning in Recurrent Neural Networks

Using recurrent neural network to estimate irreducible stochasticity in human choice behavior

Flexible gating between subspaces in a neural network model of internally guided task switching

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases

From Learning to Choosing: How Decision-Making Evolves with Experience in Rats

Predicting human decision making in psychological tasks with recurrent neural networks.

Predicting human decision making in psychological tasks with recurrent neural networks