Abstract:Reward information flows through neuronal ensembles in the nucleus accumbens shell (NAcSh), influencing decision-making. We investigated this phenomenon by training rats in a self-guided probabilistic choice task while recording single-unit activity in the NAcSh. We found that rats dynamically adapted their choices based on an internal representation of reward likelihood. Neuronal ensembles in the NAcSh act as dynamic modules to process different aspects of reward-guided behavior. Ensembles dynamically change composition and functional connections throughout reinforcement learning. The NAcSh forms a highly connected network with a heavy-tailed distribution and neuronal hubs, facilitating efficient reward information flow. Reward delivery evokes higher mutual information between ensembles and unifies network activity, while omission leads to less synchronization. Our recordings shed light on how reward information propagates through dynamically changing ensembles of neurons in the NAcSh. These functional ensembles exhibit flexible membership, dropping in and out and even shrinking in number as the rat learns to obtain (energy) rewards in an ever-changing environment.

What problem does this paper attempt to address?

This paper discusses how the flow of reward information through the neural population of the nucleus accumbens shell (NAcSh) affects the decision-making process. The study trained rats to perform a self-guided probabilistic choice task and recorded single-unit activity in the NAcSh, finding that rats can dynamically adjust their choices based on internal representations of reward likelihood. The neural population in the NAcSh serves as a dynamic module that processes different aspects of reward-guided behavior, with its composition and functional connectivity changing throughout the reinforcement learning process. The NAcSh forms a highly connected network characterized by heavy-tailed distributions and neural hubs, which facilitates efficient propagation of reward information. Reward transmission increases mutual information between neural populations, synchronizing network activity, while omission leads to reduced synchrony. Recordings show that the membership of these functional populations in the NAcSh is flexible and can decrease as rats learn to acquire energy rewards in a changing environment. In the study, rats performed a self-guided probabilistic choice task relying solely on reward outcomes as decision feedback, without external cues. Multiple analysis techniques, including time warping, ROC analysis, principal component analysis (PCA), t-SNE, hierarchical clustering, and network modeling, were used to reveal the functional connectivity between NAcSh neurons. The experimental results demonstrate that rats dynamically adjust their choices based on reward probability and reward history. They are more inclined to choose the lever previously associated with reward and can use the history of rewards to guide their decisions, exhibiting a "win-stay, lose-switch" strategy. The rats' performance in the task improves with learning, as they update their behavior based solely on the presence or absence of reward, in the absence of external cues. Electrophysiological analysis reveals that individual neurons in the NAcSh encode choice, reward outcomes, and rhythmic licking behavior. Most neurons are sensitive to reward outcomes, particularly when the reward is delivered, while some neurons are associated with choice or licking behavior. Population-level analysis uncovers distinct patterns in PCA space corresponding to reward delivery and omission, indicating that the NAcSh tracks reward processing at the population level. In summary, this study reveals how the neural population in the NAcSh dynamically encodes and processes reward information in complex tasks, providing new insights into how reward information is transmitted in the brain.

The flow of reward information through neuronal ensembles in the accumbens

The flow of reward information through neuronal ensembles in the accumbens

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

Medial accumbens shell spiny projection neurons encode relative reward preference

Dopamine release in the nucleus accumbens core signals perceived saliency

Reward Cues in Space: Commonalities and Differences in Neural Coding by Hippocampal and Ventral Striatal Ensembles

Neural activity ramps in frontal cortex signal extended motivation during learning

Reward integration in prefrontal-cortical and ventral-hippocampal nucleus accumbens inputs cooperatively modulates engagement

Distinct reward processing by subregions of the nucleus accumbens

Nucleus accumbens dopamine release reflects Bayesian inference during instrumental learning

Distinct dynamics and intrinsic properties in ventral tegmental area populations mediate reward association and motivation

Dopamine-independent effect of rewards on choices through hidden-state inference

Decomposed frontal corticostriatal ensemble activity changes across trials, revealing distinct features relevant to outcome-based decision making

Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues

Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning

Prelimbic neuron assemblies with delayed activation encode the economic decision-making process in a bandit game

Neural mechanisms of distributed value representations and learning strategies

Temporal dynamics of nucleus accumbens neurons in male mice during reward seeking

Intrinsic Reward-Like Dopamine and Acetylcholine Dynamics in Striatum

Neural Circuits for Reward

Abstraction of Reward Context Facilitates Relative Reward Coding in Neural Populations of the Macaque Anterior Cingulate Cortex