Abstract:Dopamine (DA) and norepinephrine (NE) have been repeatedly implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although two neuromodulators share a synthesis pathway and are co-activated under states of arousal, they engage in distinct circuits and modulatory roles. However, the specific role of each neuromodulator in decision making, in particular the exploration-exploitation tradeoff, remains unclear. Revealing how each neuromodulator contributes to exploration-exploitation tradeoff is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of these two catecholamine systems in regulating exploration, a direct comparison using the same dynamic decision making task is needed. Here, we ran male and female mice in a restless two-armed bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA antagonist (flupenthixol), a nonselective DA agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine on exploration. Increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. The modulatory effect of beta-noradrenergic receptor activity on exploration was mediated by sex. Reinforcement learning model parameters suggested that dopamine modulation affected exploration via decision noise and norepinephrine modulation affected exploration via sensitivity to outcome. Together, these findings suggested that the mechanisms that govern the exploration-exploitation transition are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration.Significance Statement Both dopamine (DA) and norepinephrine (NE) have been implicated in the decision making process. Although these two catecholamines have shared aspects of their biosynthetic pathways and projection targets, they are thought to exert many core functions via distinct neural targets and receptor subtypes. However, the computational neuroscience literature often ascribes similar roles to these catecholamines, despite the above evidence. Resolving this discrepancy is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. This study examines the role of dopamine and norepinephrine on the explore-exploit tradeoff. By testing mice, we were able to compare multiple pharmacological agents within subjects, and examine sources of individual differences, allowing direct comparison between the effects of these two catecholamines in modulating decision making.

Dopamine activity in the nigrostriatal pathway alters cue‐induced risky choice patterns in female rats

D2/3 Agonist during Learning Potentiates Cued Risky Choice

Circuit and Cell-Specific Contributions to Decision Making Involving Risk of Explicit Punishment in Male and Female Rats

Prefrontal Dopaminergic Regulation of Cue-Guided Risky Decision-Making Performance in Rats

Sex differences in sensitivity to dopamine receptor manipulations of risk-based decision making in rats

Serotonergic and Dopaminergic Modulation of Gambling Behavior As Assessed Using a Novel Rat Gambling Task.

Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation

A selective role for dopamine in stimulus-reward learning

Affective and cognitive mechanisms of risky decision making

Decoupling Dopamine Synthesis from Impulsive Action, Risk-Related Decision-Making, and Propensity to Cocaine Intake: A Longitudinal [18F]-FDOPA PET Study in Roman High- and Low-Avoidance Rats

Involvement of dopamine D3 receptor in impulsive choice decision-making in male rats

Chemogenetic activation of ventral tegmental area GABA neurons, but not mesoaccumbal GABA terminals, disrupts responding to reward-predictive cues

Viral over-expression of D1 dopamine receptors in the prefrontal cortex increase high-risk behaviors in adults: comparison with adolescents

Ventral Striatal D2/3 Receptor Availability Is Associated with Impulsive Choice Behavior As Well As Limbic Corticostriatal Connectivity

Mesencephalic projections to the nucleus accumbens shell modulate value updating during probabilistic reversal learning

Triggered Temptations: A New Procedure to Compare Reward-Seeking Behaviour Induced by Discriminative and Conditioned Stimuli in Rats

Dopamine and Norepinephrine Differentially Mediate the Exploration-exploitation Tradeoff

Dissociable Control of Impulsivity in Rats by Dopamine D2/3 Receptors in the Core and Shell Subregions of the Nucleus Accumbens

D2 dopamine receptor expression, reactivity to rewards, and reinforcement learning in a complex value-based decision-making task

Increased Striatal Dopamine Synthesis Capacity in Gambling Addiction

Loss of Plasticity in the D2-Accumbens Pallidal Pathway Promotes Cocaine Seeking