Abstract:Dopamine (DA) and norepinephrine (NE) have been repeatedly implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although two neuromodulators share a synthesis pathway and are co-activated under states of arousal, they engage in distinct circuits and modulatory roles. However, the specific role of each neuromodulator in decision making, in particular the exploration-exploitation tradeoff, remains unclear. Revealing how each neuromodulator contributes to exploration-exploitation tradeoff is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of these two catecholamine systems in regulating exploration, a direct comparison using the same dynamic decision making task is needed. Here, we ran male and female mice in a restless two-armed bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA antagonist (flupenthixol), a nonselective DA agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine on exploration. Increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. The modulatory effect of beta-noradrenergic receptor activity on exploration was mediated by sex. Reinforcement learning model parameters suggested that dopamine modulation affected exploration via decision noise and norepinephrine modulation affected exploration via sensitivity to outcome. Together, these findings suggested that the mechanisms that govern the exploration-exploitation transition are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration.Significance Statement Both dopamine (DA) and norepinephrine (NE) have been implicated in the decision making process. Although these two catecholamines have shared aspects of their biosynthetic pathways and projection targets, they are thought to exert many core functions via distinct neural targets and receptor subtypes. However, the computational neuroscience literature often ascribes similar roles to these catecholamines, despite the above evidence. Resolving this discrepancy is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. This study examines the role of dopamine and norepinephrine on the explore-exploit tradeoff. By testing mice, we were able to compare multiple pharmacological agents within subjects, and examine sources of individual differences, allowing direct comparison between the effects of these two catecholamines in modulating decision making.

Contrasting Roles of Dopamine and Noradrenaline in the Motivational Properties of Social Play Behavior in Rats

Social Play Behavior in Adolescent Rats is Mediated by Functional Activity in Medial Prefrontal Cortex and Striatum

Cellular Activation in Limbic Brain Systems During Social Play Behaviour in Rats

Social Dominance in Rats: Effects on Cocaine Self-Administration, Novelty Reactivity and Dopamine Receptor Binding and Content in the Striatum

Modulation of High Impulsivity and Attentional Performance in Rats by Selective Direct and Indirect Dopaminergic and Noradrenergic Receptor Agonists

Psychostimulants and social behaviors

Dopamine and Norepinephrine Differentially Mediate the Exploration-exploitation Tradeoff

Roles of NMDA and Dopamine in Food-Foraging Decision-Making Strategies of Rats in the Social Setting

Noradrenergic Versus Dopaminergic Modulation of Impulsivity, Attention and Monitoring Behaviour in Rats Performing the Stop-Signal Task

Contrasting Roles for Dopamine D1 and D2 Receptor Subtypes in the Dorsomedial Striatum but Not the Nucleus Accumbens Core During Behavioral Inhibition in the Stop-Signal Task in Rats.

Noradrenaline, Dopamine, and Brain-Stimulation Reward.

Characterization of operant social interaction in rats: effects of access duration, effort, peer familiarity, housing conditions, and choice between social interaction vs. food or remifentanil

Opportunities for risk‐taking during play alters cognitive performance and prefrontal inhibitory signalling in rats of both sexes

A selective role for dopamine in stimulus-reward learning

Dissociable Control of Impulsivity in Rats by Dopamine D2/3 Receptors in the Core and Shell Subregions of the Nucleus Accumbens

Responses and Functions of Dopamine in Nucleus Accumbens Core During Social Behaviors.

Different Effects of Peer Sex on Operant Responding for Social Interaction and Striatal Dopamine Activity

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

Norepinephrine and Dopamine Modulate Impulsivity on the Five-Choice Serial Reaction Time Task Through Opponent Actions in the Shell and Core Sub-Regions of the Nucleus Accumbens

Methylphenidate-induced Impulsivity: Pharmacological Antagonism by Β-Adrenoreceptor Blockade

Pharmacological and pupillary evidence for the noradrenergic contribution to reinforcement learning in Parkinson's disease