Abstract:Cognitive behaviour requires complex context-dependent mapping between sensory stimuli and actions. The same stimulus can lead to different behaviours depending on the situation, or the same behaviour may be elicited by different cueing stimuli. Neurons in the primate prefrontal cortex show task-specific firing activity during working memory delay periods. These neurons provide a neural substrate for mapping stimulus and response in a flexible, context- or rule-dependent, fashion. We describe here an integrate-and-fire network model to explain and investigate the different types of working-memory-related neuronal activity observed. The model contains different populations (or pools) of neurons (as found neurophysiologically) in attractor networks which respond in the delay period to the stimulus object, the stimulus position ('sensory pools'), to combinations of the stimulus sensory properties (e.g. the object identity or object location) and the response ('intermediate pools'), and to the response required (left or right) ('premotor pools'). The pools are arranged hierarchically, are linked by associative synaptic connections, and have global inhibition through inhibitory interneurons to implement competition. It is shown that a biasing attentional input to define the current rule applied to the intermediate pools enables the system to select the correct response in what is a biased competition model of attention. The integrate-and-fire model not only produces realistic spiking dynamicals very similar to the neuronal data but also shows how dopamine could weaken and shorten the persistent neuronal activity in the delay period; and allows us to predict more response errors when dopamine is elevated because there is less different activity in the different pools of competing neurons, resulting in more conflict.

Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis

Evidence for interacting but decoupled controls of decisions and movements in non-human primates

Neuronal Representation of a Working Memory-Based Decision Strategy in the Motor and Prefrontal Cortico-Basal Ganglia Loops

Working memory as a representational template for reinforcement learning

Learning at Variable Attentional Load Requires Cooperation of Working Memory, Meta-learning, and Attention-augmented Reinforcement Learning

Using TD learning to simulate working memory performance in a model of the prefrontal cortex and basal ganglia

Serial decision-making in monkeys during an oculomotor task.

Exploring the dynamic interplay between learning and working memory within various cognitive contexts

Monkeys engage in visual simulation to solve complex problems

Cortico-subcortical dynamics in primate working memory

How Working Memory and Reinforcement Learning Are Intertwined: A Cognitive, Neural, and Computational Perspective

Working Memory Guides Action Valuation in Model-based Decision-making Strategy.

Dopamine firing plays a double role in coding reward prediction errors and signaling motivation in a working memory task

Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia

Comparing species decisions in a dichotomous choice task: adjusting task parameters improves performance in monkeys

Attention and Working Memory: a Dynamical Model of Neuronal Activity in the Prefrontal Cortex

Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops