The Anterior and Midcingulate Cortices and Reward

E. Rolls

2008-01-01

Abstract:rewards 196 Effects of cognitive states on reward representations in ACC 197

What problem does this paper attempt to address?

Electrophysiological Mechanisms in the Anterior Insula Cortex during Reward Expectancy

Linglin Yang,Katia Lehongre,Hongyi Ye,XinFeng Yu,Vincent Navarro,Sen Cheng,Zheng Lin,Nikolai Axmacher,Shuang Wang,Hui Zhang

DOI: https://doi.org/10.1101/2023.09.19.558205

2023-01-01

Abstract:Reward expectancy contributes to behavioral performance by coordinating the allocation of cognitive resources, which incorporates the involvement of the anterior insular cortex (AIC). To investigate the electrophysiological mechanisms underlying reward expectancy in the AIC, we collected intracranial electroencephalography (iEEG) data from epilepsy patients implanted for clinical purposes. During the recording, they navigated a virtual T-maze where they encountered rewards at three predetermined locations. We focused on the time window proximal to entering the reward zone, which was defined as the expectancy stage. During this stage, a strong phase-amplitude coupling (PAC) effect was found between local theta oscillation and gamma activity within the AIC. Interestingly, the PAC effect exhibited a specific temporal structure in which the peak gamma power was progressively coupled to an earlier theta phase before each onset of the same reward. Meanwhile, the reward-specific brain patterns were pre-activated during the expectancy stage of rewards. This pre-activation was tended to take place simultaneously with the occurrence of peak gamma activities across individual trials. Furthermore, the pre-activation of reward-specific patterns also progressively shifted forward on theta phases as more trials were conducted. These phenomena of phase shift were reminiscent of the phase precession effect in which single neurons fire at progressively earlier phases of low-frequency oscillations, and thus were called phase-precession-like effects (PPLEs). Additionally, subjects exhibiting PPLEs in the AIC presented less variability and a more notable improvement in response latency across trials. These results revealed possible electrophysiological mechanisms of the AIC underlying reward expectancy. ![Graphic abstract:][1]</img> Graphic abstract: ### Competing Interest Statement The authors have declared no competing interest. [1]: pending:yes
The Anterior and Midcingulate Cortices and Reward

Edmund T Rolls

DOI: https://doi.org/10.1093/oso/9780198566960.003.0008

2009-01-01

Abstract:Abstract The anterior cingulate cortex (ACC) occupies approximately the anterior one third of the cingulate cortex and is implicated in emotion. Figure 8.1 shows areas 24 and 32 in the pregenual ACC and area 25 in the subgenual ACC. The ACC is distinguished from the midcingulate cortex (MCC) which occupies approximately the middle third of the cingulate cortex and is comprised of areas 24a´b´ and 24d; the latter of which contains part of the caudal cingulate motor area (Chapters 1, 3, and 5) and may be involved in response selection (Rushworth et al., 2004). In what follows, I will distinguish the anterior or pregenual cingulate cortex (pACC) from the midcingulate cortex (MCC).Vogt et al. (1996) showed that pain produced an increase in regional cerebral blood flow (rCBF), measured with positron emission tomography (PET) in an area of ACC which included parts of areas 25, 32, 24a, 24b, and/or 24c. They suggested that activation of this region is related to the affective aspect of pain. There are direct projections to the cingulate cortex from medial thalamic nuclei that relay pain inputs, including the parafascicular nucleus. In terms of other connections (Van Hoesen et al., 1993; Vogt and Pandya, 1987; Vogt et al., 1987), the ACC is connected to the medial orbitofrontal areas, parts of lateral orbitofrontal area 12 (Carmichael and Price, 1995), the amygdala (which projects strongly to cingulate areas, 25, 24 and 32), and the temporal pole cortex, and also receives somatosensory inputs from the insula and other somatosensory cortical areas (Fig. 8.1).
Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation

Eliana Vassena,Massimo Silvetti,Carsten N. Boehler,Eric Achten,Wim Fias,Tom Verguts

DOI: https://doi.org/10.1371/journal.pone.0091008

IF: 3.7

2014-03-07

PLoS ONE

Abstract:Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.

multidisciplinary sciences
Rapid Processing of Both Reward Probability and Reward Uncertainty in the Human Anterior Cingulate Cortex

Rongjun Yu,Wu Zhou,Xiaolin Zhou

DOI: https://doi.org/10.1371/journal.pone.0029633

IF: 3.7

2011-12-27

PLoS ONE

Abstract:Reward probability and uncertainty are two fundamental parameters of decision making. Whereas reward probability indicates the prospect of winning, reward uncertainty, measured as the variance of probability, indicates the degree of risk. Several lines of evidence have suggested that the anterior cingulate cortex (ACC) plays an important role in reward processing. What is lacking is a quantitative analysis of the encoding of reward probability and uncertainty in the human ACC. In this study, we addressed this issue by analyzing the feedback-related negativity (FRN), an event-related potential (ERP) component that reflects the ACC activity, in a simple gambling task in which reward probability and uncertainty were parametrically manipulated through predicting cues. Results showed that at the outcome evaluation phase, while both win and loss-related FRN amplitudes increased as the probability of win or loss decreased, only the win-related FRN was modulated by reward uncertainty. This study demonstrates the rapid encoding of reward probability and uncertainty in the human ACC and offers new insights into the functions of the ACC.

multidisciplinary sciences
The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards

Matthew A. J. Apps,Narender Ramnani,M. A. J. Apps,N. Ramnani

DOI: https://doi.org/10.1523/jneurosci.2701-13.2014

2014-04-30

Journal of Neuroscience

Abstract:Evaluating the costs and benefits of our own choices is central to most forms of decision-making and its mechanisms in the brain are becoming increasingly well understood. To interact successfully in social environments, it is also essential to monitor the rewards that others receive. Previous studies in nonhuman primates have found neurons in the anterior cingulate cortex (ACC) that signal the net value (benefit minus cost) of rewards that will be received oneself and also neurons that signal when a reward will be received by someone else. However, little is understood about the way in which the human brain engages in cost-benefit analyses during social interactions. Does the ACC signal the net value (the benefits minus the costs) of rewards that others will receive? Here, using fMRI, we examined activity time locked to cues that signaled the anticipated reward magnitude (benefit) to be gained and the level of effort (cost) to be incurred either by a subject themselves or by a social confederate. We investigated whether activity in the ACC covaries with the net value of rewards that someone else will receive when that person is required to exert effort for the reward. We show that, although activation in the sulcus of the ACC signaled the costs on all trials, gyral ACC (ACC(g)) activity varied parametrically only with the net value of rewards gained by others. These results suggest that the ACC(g) plays an important role in signaling cost-benefit information by signaling the value of others' rewards during social interactions.

neurosciences
Dissociating affective evaluation and social cognitive processes in the ventral medial prefrontal cortex

Wouter van den Bos,Samuel M. McClure,Lasana T. Harris,Susan T. Fiske,Jonathan D. Cohen

DOI: https://doi.org/10.3758/cabn.7.4.337

2007-12-01

Abstract:In recent studies, various regions of the ventral medial prefrontal cortex (vmPFC) have been implicated in at least two potentially different mental functions: reasoning about the minds of other people (social cognition) and processing reward related information (affective evaluation). In this study, we test whether the activation in a specific area of the vmPFC, the para-anterior cingulate cortex (PACC), correlates with the reward value of stimuli in general or is specifically associated with social cognition. Participants performed a time estimation task with trial-to-trial feedback in which reward and social context were manipulated separately. Reward was manipulated by giving either positive or negative feedback in the form of small squirts of fluid delivered orally. Social context was manipulated by instructing participants that positive and negative feedback was determined by another person or a computer. The data demonstrate a main effect of feedback, but not social context, in the PACC, suggesting that this area of the vmPFC serves a general function in evaluating and/or representing reward value. In addition, activity in a more anterior subregion of the vmPFC demonstrated reward-related sensitivity only in the social context. Another area that showed a similar interaction was the subgenual cingulate, but this region was only sensitive to negative feedback in the social condition. These findings suggest that, within the vmPFC, the PACC subserves primarily an affective function, whereas in other regions social context can modulate affective responses.

behavioral sciences,neurosciences
Prefrontal Contributions to Reward Encoding

E.T. Rolls

DOI: https://doi.org/10.1016/B978-008045046-9.00856-1

2009-01-01

Abstract:The human orbitofrontal cortex is activated by rewards and punishers in the taste, olfactory, visual, somatosensory, and auditory modalities and is thus involved in emotion. Its activation is correlated with the subjective pleasantness or unpleasantness of these stimuli. The orbitofrontal cortex is also activated by abstract rewards and punishers, such as winning or losing money, and its activation can be modulated by cognitive factors. The orbitofrontal cortex is also activated when an expected reward is not obtained and behavior should change. Lesions of the orbitofrontal cortex can impair reward-related (reversal) learning, impair face and voice expression identification, and produce impulsive behavior and disinhibited emotional behavior. The most anterior, pregenual, cingulate cortex receives from the orbitofrontal cortex and may be one route for the orbitofrontal cortex to influence behavior, as shown by its activation in similar tasks and the effects of lesions to it.
Lesions of anterior cingulate cortex disrupt an electrophysiological signature of reward processing in humans

Joyce Oerlemans,Ricardo J Alejandro,Dimitri Hemelsoet,Eva Genbrugge,Katie Bouche,Luc Defreyne,Veerle De Herdt,Clay B Holroyd

DOI: https://doi.org/10.1101/2024.12.04.626789

2024-12-07

Abstract:The reward positivity (RewP) is an event-related brain potential (ERP) component associated with feedback and reward processing. Although the component is said to be generated in anterior cingulate cortex (ACC), this inference is disputed because of the inverse problem. Recently, by conducting a current source density analysis of intracranial electroencephalogram (EEG) data recorded from a large cohort of epilepsy patients, we provided direct evidence that the RewP is produced by a circumscribed region in caudal ACC corresponding to Brodmann areas 24c and 32. In the present study we confirm that this brain area is the source of the RewP by examining the effects of damage to frontal cortex on RewP amplitude. We recorded scalp EEG from 68 stroke patients with damage to frontal cortex while they engaged in a trial-and-error guessing task used to elicit a canonical RewP. Application of non-parametric voxel-based lesion-symptom mapping to the lesion data revealed that damage to Brodmann areas 24c and 3 attenuated RewP amplitude, whereas damage to other parts of frontal cortex did not affect it. These results provide causal evidence that the caudal ACC generates the RewP and underscore the contribution of this brain region toward motivating extended behaviors.

Neuroscience
Anterior cingulate activity during error and autonomic response

Hugo D Critchley,Joey Tang,Daniel Glaser,Brian Butterworth,Raymond J Dolan

DOI: https://doi.org/10.1016/j.neuroimage.2005.05.047

IF: 5.7

2005-10-01

NeuroImage

Abstract:The contribution of anterior cingulate cortex (ACC) to human cognition remains unclear. The rostral (rACC) and dorsal (dACC) ACC cortex are implicated in tasks that require increased response control due to emotional and cognitive interference, respectively. However, both rACC and dACC are activated by conditions that induce changes in visceral arousal, suggesting that ACC supports a generation of integrated bodily responses. To clarify the relationship between purely cognitive and psychophysiological accounts of ACC function, we scanned 15 subjects using functional magnetic resonance imaging while they performed numerical versions of the Stroop task. To index autonomic arousal, we simultaneously measured pupil diameter. Performance errors accounted for most of the variance in a pupil-derived measure of evoked autonomic arousal. In analysis of the functional imaging data, activity within a region spanning rACC and dACC predicted trial-by-trial variation in autonomic response magnitude and was enhanced during error trials, shown using conjunction analyses. Activity within other loci within rACC predicted evoked autonomic arousal and showed sensitivity to errors but did not meet criteria for both. These data highlight the role of ACC in psychophysiological aspects of error processing and suggest that an interface exists within ACC between cognitive and biobehavioral systems in the service of response adaptation.
Abstraction of Reward Context Facilitates Relative Reward Coding in Neural Populations of the Macaque Anterior Cingulate Cortex

Jonathan M Chien,Joni D Wallis,Erin L Rich

DOI: https://doi.org/10.1523/JNEUROSCI.0292-23.2023

2023-08-16

Abstract:The anterior cingulate cortex (ACC) is believed to be involved in many cognitive processes, including linking goals to actions and tracking decision-relevant contextual information. ACC neurons robustly encode expected outcomes, but how this relates to putative functions of ACC remains unknown. Here, we approach this question from the perspective of population codes by analyzing neural spiking data in the ventral and dorsal banks of the ACC in two male monkeys trained to perform a stimulus-motor mapping task to earn rewards or avoid losses. We found that neural populations favor a low dimensional representational geometry that emphasizes the valence of potential outcomes while also facilitating the independent, abstract representation of multiple task-relevant variables. Valence encoding persisted throughout the trial, and realized outcomes were primarily encoded in a relative sense, such that cue valence acted as a context for outcome encoding. This suggests that the population coding we observe could be a mechanism that allows feedback to be interpreted in a context-dependent manner. Together, our results point to a prominent role for ACC in context setting and relative interpretation of outcomes, facilitated by abstract, or untangled, representations of task variables.SIGNIFICANCE STATEMENT The ability to interpret events in light of the current context is a critical facet of higher-order cognition. The ACC is suggested to be important for tracking contextual information, whereas alternate views hold that its function is more related to the motor system and linking goals to appropriate actions. We evaluated these possibilities by analyzing geometric properties of neural population activity in monkey ACC when contexts were determined by the valence of potential outcomes and found that this information was represented as a dominant, abstract concept. Ensuing outcomes were then coded relative to these contexts, suggesting an important role for these representations in context-dependent evaluation. Such mechanisms may be critical for the abstract reasoning and generalization characteristic of biological intelligence.
Reward Neurophysiology and Orbitofrontal Cortex

E.T. Rolls

DOI: https://doi.org/10.1016/B978-008045046-9.01560-6

2009-01-01

Abstract:The (primate and human) orbitofrontal cortex receives taste, olfactory, visual, somatosensory, and auditory inputs from cortical regions which are toward the end of the unimodal cortical processing streams that build representations of what stimulus is present in each of these sensory modalities. Neurophysiological studies in primates show that it is the reward value of taste, olfactory, oral texture, and visual stimuli that is represented, as shown, for example, by the reduction to zero of the neuronal responses after feeding to satiety on a particular food. The reward is partly specific to a particular food, as shown by sensory-specific satiety-related neuronal responses. Visual and olfactory stimuli become rewarding by learned association with a primary (unlearned) reinforcer such as the taste of food. This learning can be reversed (in as little as one trial for visual stimuli) and may be facilitated by error neurons that respond when an expected reward is not obtained. Complementary neuroimaging studies in humans show that abstract reinforcers such as monetary reward are also represented in the orbitofrontal cortex, and that the expected value of a reward may be represented in the orbitofrontal cortex.
Optimal decision making and the anterior cingulate cortex

Steven W Kennerley,Mark E Walton,Timothy E J Behrens,Mark J Buckley,Matthew F S Rushworth

DOI: https://doi.org/10.1038/nn1724

IF: 25

2006-06-18

Nature Neuroscience

Abstract:Learning the value of options in an uncertain environment is central to optimal decision making. The anterior cingulate cortex (ACC) has been implicated in using reinforcement information to control behavior. Here we demonstrate that the ACC's critical role in reinforcement-guided behavior is neither in detecting nor in correcting errors, but in guiding voluntary choices based on the history of actions and outcomes. ACC lesions did not impair the performance of monkeys (Macaca mulatta) immediately after errors, but made them unable to sustain rewarded responses in a reinforcement-guided choice task and to integrate risk and payoff in a dynamic foraging task. These data suggest that the ACC is essential for learning the value of actions.

neurosciences
Reward Systems in the Brain and Nutrition.

Edmund T. Rolls

DOI: https://doi.org/10.1146/annurev-nutr-071715-050725

2016-01-01

Annual Review of Nutrition

Abstract:The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.
The Reward Circuit: Linking Primate Anatomy and Human Imaging

Suzanne N Haber,Brian Knutson

DOI: https://doi.org/10.1038/npp.2009.129

2009-10-07

Neuropsychopharmacology

Abstract:Although cells in many brain regions respond to reward, the cortical-basal ganglia circuit is at the heart of the reward system. The key structures in this network are the anterior cingulate cortex, the orbital prefrontal cortex, the ventral striatum, the ventral pallidum, and the midbrain dopamine neurons. In addition, other structures, including the dorsal prefrontal cortex, amygdala, hippocampus, thalamus, and lateral habenular nucleus, and specific brainstem structures such as the pedunculopontine nucleus, and the raphe nucleus, are key components in regulating the reward circuit. Connectivity between these areas forms a complex neural network that mediates different aspects of reward processing. Advances in neuroimaging techniques allow better spatial and temporal resolution. These studies now demonstrate that human functional and structural imaging results map increasingly close to primate anatomy.

pharmacology & pharmacy,neurosciences,psychiatry
Effects of anterior cingulate cortex lesions on responding for conditioned reinforcement, discrete fear conditioning, autoshaping performance and Pavlovian-instrumental transfer

RN Cardinal,G Lachenal,JA Parkinson,TW Robbins,BJ Everitt

IF: 3.698

2000-01-01

European Journal of Neuroscience

Abstract:• The anterior cingulate cortex (Ant Cing) is a major cortical component of the ‘limbic loop’ of the basal ganglia. It has previously been implicated in stimulus–reward learning in the rat (Bussey et al., 1996; Bussey et al., 1997a; Bussey et al., 1997b) and other rodents (e.g. Gabriel & Orona, 1982; Gabriel et al., 1991). • However, the exact contribution that the Ant Cing makes to processes of stimulus–reward learning and Pavlovian conditioning is not well understood. • Therefore, rats with lesions of the Ant Cing were tested on a range of tasks to which some aspect of stimulus–reinforcer learning was expected to contribute.
Dorsal Anterior Cingulate Cortex Encodes the Integrated Incentive Motivational Value of Cognitive Task Performance

Debbie M Yee,Jennifer L Crawford,Bidhan Lamichhane,Todd S Braver

DOI: https://doi.org/10.1523/JNEUROSCI.2550-20.2021

2021-04-21

Abstract:Humans can seamlessly combine value signals from diverse motivational incentives, yet it is not well understood how these signals are "bundled" in the brain to modulate cognitive control. The dorsal ACC (dACC) is theorized to integrate motivational value dimensions in the service of goal-directed action, although this hypothesis has yet to receive rigorous confirmation. In the present study, we examined the role of human dACC in motivational incentive integration. Healthy young adult men and women were scanned with fMRI while engaged in an experimental paradigm that quantifies the combined effects of liquid (e.g., juice, neutral, saltwater) and monetary incentives on cognitive task performance. Monetary incentives modulated trial-by-trial dACC activation, whereas block-related effects of liquid incentives on dACC activity were observed. When bundled together, incentive-related dACC modulation predicted fluctuations in both cognitive performance and self-report motivation ratings. Statistical mediation analyses suggest that dACC encoded the incentives in terms of their integrated subjective motivational value, and that this value signal was most proximally associated with task performance. Finally, we confirmed that these incentive integration effects were selectively present in dACC. Together, the results support an account in which dACC integrates motivational signals to compute the expected value of goal-directed cognitive control.SIGNIFICANCE STATEMENT How are primary and secondary incentives integrated in the brain to influence goal-directed behavior? Using an innovative experimental fMRI paradigm that combines motivational incentives that have historically been studied independently between species (e.g., monetary rewards for humans, food rewards for animals), we examine the relationship between incentive motivational value and cognitive control allocation. We find evidence that the integrated incentive motivational value of combined incentives is encoded in human dorsal ACC. Further, self-reported motivational shifts mediated the effects of incentive-modulated dorsal ACC activity on task performance, revealing convergence in how self-reported and experimentally induced motivation are encoded in the human brain. Our findings may inform future translational studies examining affective/motivational and cognitive impairments in psychopathology (e.g., anxiety, depression, addiction).
Excitatory neurons of the anterior cingulate cortex encode chosen actions and their outcomes rather than cognitive state

Martin M. Jendryka,Uwe Lewin,Sampath K.T. Kapanaiah,Hartmut Dermutz,Birgit Liss,Anton Pekcec,Thomas Akam,Benjamin F. Grewe,Dennis Kätzel

DOI: https://doi.org/10.1101/2024.04.12.589244

2024-04-15

Abstract:The anterior cingulate cortex (ACC) causally influences cognitive control of goal-directed behaviour. However, it is unclear whether ACC directly encodes cognitive variables like attention or impulsivity, or implements goal-directed action selection mechanisms that are modulated by them. We recorded ACC activity with miniature endoscopic microscopes in mice performing the 5-choice-serial-reaction time task, and applied decoding and encoding analyses. ACC pyramidal cells represented specific actions before and during the behavioural response, whereas the response type (e.g. correct/incorrect/premature) – indicating the state of attentional and impulse control – could only be decoded during and after the response with high reliability. Devaluation and extinction experiments further revealed that action encoding depended on reward expectation. Our findings support a role for ACC in goal-directed action selection and monitoring, that is modulated by cognitive state, rather than in tracking levels of attention or impulsivity directly in individual trials.

Neuroscience
Cognitive effort and reward. Functional imaging of time on task and the involvement of dopaminergic and cholinergic substrates

Chiara Orsini,Julia E. Bosch,Karin Labek,Roberto Viviani

DOI: https://doi.org/10.1101/2024.12.12.628171

2024-12-12

Abstract:Numerous neuroimaging studies have identified the cortical network associated with sustained cognitive efforts and control and its modulation by rewards. Different lines of evidence implicate the prefrontal cortex (especially the anterior cingulum, ACC), dopaminergic, and cholinergic substrates in this modulation. To inquire about involvement of these substrates, we studied their activity at increasing time on task (providing increasing levels of cognitive effort) in trial blocks with differing reward levels. In the cortex, while peaking in the ACC, activity associated with time on task was found to be extensive, also including activity decrements outside the default mode network, primarily involving motor and somatosensory regions. Information about reward levels was carried in the ventral tegmental area and ventral striatum, consistent with their motivational role and previous studies, but did not reflect increasing time on task. Instead, parts of the ventral forebrain corresponding to the location of cholinergic Ch4 nuclei increased in activity with time on task and were sensitive to reward levels. This finding is consistent with a cholinergic role in driving compensatory efforts modulated by reward levels, while dopaminergic substrates track levels of expected rewards irrespective of required sustained attention efforts. These findings identify a distinct neuroimaging phenotype associated with sustaining task sets and cognitive efforts.

Neuroscience
Role of the Anterior Cingulate Cortex in the Control over Behavior by Pavlovian Conditioned Stimuli in Rats.

Rudolf N. Cardinal,John A. Parkinson,Hosnieh Djafari Marbini,Andrew J. Toner,Timothy J. Bussey,Trevor W. Robbins,Barry J. Everitt

DOI: https://doi.org/10.1037/0735-7044.117.3.566

2003-01-01

Behavioral Neuroscience

Abstract:To investigate the contribution of the anterior cingulate cortex (ACC) to stimulus-reward learning, rats with lesions of peri- and postgenual ACC were tested on a variety of Pavlovian conditioning tasks. Lesioned rats learned to approach a food alcove during a stimulus predicting food, and responded normally for conditioned reinforcement. They also exhibited normal conditioned freezing and Pavlovian-instrumental transfer, yet were impaired at autoshaping. To resolve this apparent discrepancy, a further task was developed in which approach to the food alcove was under the control of 2 stimuli, only 1 of which was followed by reward. Lesioned rats were impaired, approaching during both stimuli. It is suggested that the ACC is not critical for stimulus-reward learning per se, but is required to discriminate multiple stimuli on the basis of their association with reward.
From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex

Massimo Silvetti,William Alexander,Tom Verguts,Joshua W Brown

DOI: https://doi.org/10.1016/j.neubiorev.2013.11.003

Abstract:The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior.

The Anterior and Midcingulate Cortices and Reward

Electrophysiological Mechanisms in the Anterior Insula Cortex during Reward Expectancy

The Anterior and Midcingulate Cortices and Reward

Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation

Rapid Processing of Both Reward Probability and Reward Uncertainty in the Human Anterior Cingulate Cortex

The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards

Dissociating affective evaluation and social cognitive processes in the ventral medial prefrontal cortex

Prefrontal Contributions to Reward Encoding

Lesions of anterior cingulate cortex disrupt an electrophysiological signature of reward processing in humans

Anterior cingulate activity during error and autonomic response

Abstraction of Reward Context Facilitates Relative Reward Coding in Neural Populations of the Macaque Anterior Cingulate Cortex

Reward Neurophysiology and Orbitofrontal Cortex

Optimal decision making and the anterior cingulate cortex

Reward Systems in the Brain and Nutrition.

The Reward Circuit: Linking Primate Anatomy and Human Imaging

Effects of anterior cingulate cortex lesions on responding for conditioned reinforcement, discrete fear conditioning, autoshaping performance and Pavlovian-instrumental transfer

Dorsal Anterior Cingulate Cortex Encodes the Integrated Incentive Motivational Value of Cognitive Task Performance

Excitatory neurons of the anterior cingulate cortex encode chosen actions and their outcomes rather than cognitive state

Cognitive effort and reward. Functional imaging of time on task and the involvement of dopaminergic and cholinergic substrates

Role of the Anterior Cingulate Cortex in the Control over Behavior by Pavlovian Conditioned Stimuli in Rats.

From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex