Abstract:Previous theoretical work has shown that a single-layer neural network can implement the optimal decision process for simple, two-alternative forced-choice (2AFC) tasks. However, it is likely that the mammalian brain comprises multilayer networks, raising the question of whether and how optimal performance can be approximated in such an architecture. Here, we present theoretical work suggesting that the noradrenergic nucleus locus coeruleus (LC) may help optimize 2AFC decision making in the brain. This is based on the observations that neurons of the LC selectively fire following the presentation of salient stimuli in decision tasks and that the corresponding release of norepinephrine can transiently increase the responsivity, or gain, of cortical processing units. We describe computational simulations that investigate the role of such gain changes in optimizing performance of 2AFC decision making. In the tasks we model, no prior cueing or knowledge of stimulus onset time is assumed. Performance is assessed in terms of the rate of correct responses over time (the reward rate). We first present the results of a single-layer model that accumulates (integrates) sensory input and implements the decision process as a threshold crossing. Gain transients, representing the modulatory effect of the LC, are driven by separate threshold crossings in this layer. We optimize over all free parameters to determine the maximum reward rate achievable by this model and compare it to the maximum reward rate when gain is held fixed. We find that the dynamic gain mechanism yields no improvement in reward for this single-layer model. We then examine a two-layer model, in which competing sensory accumulators in the first layer (capable of implementing the task relevant decision) pass activity to response accumulators in a second layer. Again, we compare a version in which threshold crossing in the first (decision) layer elicits an LC response (and a concomitant increase in gain) with a fixed-gain version of the model. Here, we find that gain transients modeling the LC phasic response yield an improvement in reward rate of 12% to 24%. Furthermore, we show that the timing characteristics of these gain transients agree with observations concerning LC firing patterns reported in recent experimental studies. This provides converging evidence for the hypothesis that the LC optimizes processes underlying 2AFC decision making in multilayer networks.

Multi-Scale Expressions of One Optimal State Regulated by Dopamine in the Prefrontal Cortex

Dopamine modulation of prefrontal cortex activity is manifold and operates at multiple temporal and spatial scales

Medial Prefrontal Cortex and Anteromedial Thalamus Interaction Regulates Goal-Directed Behavior and Dopaminergic Neuron Activity

Medial Prefrontal Cortex Interacts with the Anteromedial Thalamus in Motivation and Dopaminergic Activity

Dopamine Modulation of GABAergic Function Enables Network Stability and Input Selectivity for Sustaining Working Memory in a Computational Model of the Prefrontal Cortex

A large-scale neural network model of the influence of neuromodulatory levels on working memory and behavior

A Domain-General Frontoparietal Network Interacts with Domain-Preferential Intermediate Pathways to Support Working Memory Task.

Regional Excitation-Inhibition Balance Predicts Default-Mode Network Deactivation Via Functional Connectivity.

Comodulation of Dopamine and Serotonin on Prefrontal Cortical Rhythms: A Theoretical Study

Optimization of decision making in multilayer networks: the role of locus coeruleus

State-dependent regulation of cortical processing speed via gain modulation

A Neurocomputational Theory of the Dopaminergic Modulation of Working Memory Functions

Dopamine and Cognitive Control in Prefrontal Cortex

Medial prefrontal dopamine dynamics reflect allocation of selective attention

Dopamine Modulation Of The Prefrontal Cortex And Cognitive Function

Amphetamine Exerts Dose-Dependent Changes in Prefrontal Cortex Attractor Dynamics during Working Memory

A dopamine gradient controls access to distributed working memory in the large-scale monkey cortex

Neuromodulation of prefrontal cortex cognitive function in primates: the powerful roles of monoamines and acetylcholine

The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty

Ventral tegmental area dopamine neural activity switches simultaneously with rule representations in the prefrontal cortex and hippocampus

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine