Naphthylalkyl lactamimides as inhibitors of blood platelet aggregation.

E. M. Roberts,J. M. Grisar,R. D. Mackenzie,G. P. Claxton,T. R. Blohm

DOI: https://doi.org/10.1021/JM00282A017

IF: 8.039

1972-12-01

Journal of Medicinal Chemistry

Abstract:

What problem does this paper attempt to address?

Intertemporal Decision-Making Involves Prefrontal Control Mechanisms Associated with Working Memory

Koji Jimura,Maria S Chushak,Andrew Westbrook,Todd S Braver

DOI: https://doi.org/10.1093/cercor/bhx015

IF: 4.861

2017-02-08

Cerebral Cortex

Abstract:Intertemporal decision-making involves simultaneous evaluation of both the magnitude and delay to reward, which may require the integrated representation and comparison of these dimensions within working memory (WM). In the current study, neural activation associated with intertemporal decision-making was directly compared with WM load-related activation. During functional magnetic resonance imaging, participants performed an intermixed series of WM trials and intertemporal decision-making trials both varying in load, with the latter in terms of choice difficulty, via options tailored to each participant's subjective value function for delayed rewards. The right anterior prefrontal cortex (aPFC) and dorsolateral prefrontal cortex (dlPFC) showed activity modulation by choice difficulty within WM-related brain regions. In aPFC, these 2 effects (WM, choice difficulty) correlated across individuals. In dlPFC, activation increased with choice difficulty primarily in patient (self-controlled) individuals, and moreover was strongest when the delayed reward was chosen on the most difficult trials. Finally, the choice-difficulty effects in dlPFC and aPFC were correlated across individuals, suggesting a functional relationship between the 2 regions. Together, these results suggest a more precise account of the relationship between WM and intertemporal decision-making that is specifically tied to choice difficulty, and involves the coordinated activation of a lateral PFC circuit supporting successful self-control.

neurosciences
Executive control by fronto-parietal activity explains counterintuitive decision behavior in complex value-based decision-making

Teppei Matsui,Yoshiki Hattori,Kaho Tsumura,Ryuta Aoki,Masaki Takeda,Kiyoshi Nakahara,Koji Jimura

DOI: https://doi.org/10.1016/j.neuroimage.2022.118892

IF: 5.7

2022-04-01

NeuroImage

Abstract:In real life, humans make decisions by taking into account multiple independent factors, such as delay and probability. Cognitive psychology suggests that cognitive control mechanisms play a key role when facing such complex task conditions. However, in value-based decision-making, it still remains unclear to what extent cognitive control mechanisms become essential when the task condition is complex. In this study, we investigated decision-making behaviors and underlying neural mechanisms using a multifactor gambling task where participants simultaneously considered probability and delay. Decision-making behavior in the multifactor task was modulated by both probability and delay. The behavioral effect of probability was stronger than delay, consistent with previous studies. Furthermore, in a subset of conditions that recruited fronto-parietal activations, reaction times were paradoxically elongated despite lower probabilistic uncertainty. Notably, such a reaction time elongation did not occur in control tasks involving single factors. Meta-analysis of brain activations suggested an interpretation that the paradoxical increase of reaction time may be associated with strategy switching. Consistent with this interpretation, logistic regression analysis of the behavioral data suggested a presence of multiple decision strategies. Taken together, we found that a novel complex value-based decision-making task cause prominent activations in fronto-parietal cortex. Furthermore, we propose that these activations can be interpreted as recruitment of cognitive control system in complex situations.
Percutaneous penetration kinetics of lidocaine and prilocaine in two local anesthetic formulations assessed by in vivo microdialysis in pigs.

Huilin Wei,Yun Chen,Lanfang Xu,Jiarun Zheng

DOI: https://doi.org/10.1248/BPB.30.830

2007-04-01

Biological and Pharmaceutical Bulletin

Abstract:The aim of this study was to characterize and compare the percutaneous penetration kinetics of lidocaine (L) and prilocaine (P) in two local anesthetic formulations by in vivo microdialysis coupled with HPLC. The microdialysis system for studying lidocaine and prilocaine was calibrated by a no-net-flux method in vitro and retrodialysis method in vivo, respectively. A dosage of 0.2 g/cm2 of an in-house P-L formulation (2.5% lidocaine and 2.5% prilocaine, methylcellulose-based) and commercially available Eutectic Mixture of Local Anesthesia (EMLA, 2.5% lidocaine and 2.5% prilocaine, carbopol-based) was separately but symmetrically applied in the dorsal region of pigs. Saline (0.9%, w/v) was perfused into the linear microdialysis probe at a flow rate of 1.5 microl/min. Dialysate was collected upon topical application up to 6 h at 20-min intervals and assessed by HPLC. The results demonstrated the area under the concentration-time curve (AUC(0-6 h)) of lidocaine and prilocaine in EMLA was 71.95+/-23.36 microg h/ml and 38.01+/-14.8 microg h/ml, respectively, in comparison to 167.11+/-56.12 microg h/ml and 87.02+/-30.38 microg h/ml in the P-L formulation. The maximal concentrations (Cmax) of lidocaine and prilocaine in the dermis were 29.2+/-9.08 microg/ml and 16.54+/-5.31 microg/ml in EMLA and 80.93+/-17.98 microg/ml and 43.69+/-12.87 microg/ml in the P-L formulation, respectively. This study indicates a well-calibrated microdialysis system can provide vital real-time information on percutaneous drug delivery and specifically a methylcellulose-based P-L formulation can increase percutaneous absorption of both lidocaine and prilocaine in pigs compared to carbopol-based EMLA.
A role for the midbrain reticular formation in delay-based decision making

Yong Sang Jo,Gyeong Hee Pyeon,Sheri J. Y. Mizumori

DOI: https://doi.org/10.3389/fnsys.2024.1481585

2024-12-05

Frontiers in Systems Neuroscience

Abstract:In many real-life situations, decisions involve temporal delays between actions and their outcomes. During these intervals, waiting is an active process that requires maintaining motivation and anticipating future rewards. This study aimed to explore the role of the midbrain reticular formation (MRF) in delay-based decision-making. We recorded neural activity in the MRF while rats performed delay discounting and reward discrimination tasks, choosing between a smaller, sooner reward and a larger, later reward. Our findings reveal that MRF neurons are integral to maintaining motivation during waiting periods by encoding both the anticipated size and the discounted value of delayed rewards. Furthermore, the inactivation of the MRF led to a significant reduction in the rats' willingness to wait for delayed rewards. These results demonstrate the MRF's function in balancing the trade-offs between reward magnitude and timing, providing insight into the neural mechanisms that support sustained motivation and decision-making over time.

neurosciences
Policy adjustment in a dynamic economic game

Jian Li,Samuel M McClure,Brooks King-Casas,P Read Montague

DOI: https://doi.org/10.1371/journal.pone.0000103

IF: 3.7

2006-12-20

PLoS ONE

Abstract:Making sequential decisions to harvest rewards is a notoriously difficult problem. One difficulty is that the real world is not stationary and the reward expected from a contemplated action may depend in complex ways on the history of an animal's choices. Previous functional neuroimaging work combined with principled models has detected brain responses that correlate with computations thought to guide simple learning and action choice. Those works generally employed instrumental conditioning tasks with fixed action-reward contingencies. For real-world learning problems, the history of reward-harvesting choices can change the likelihood of rewards collected by the same choices in the near-term future. We used functional MRI to probe brain and behavioral responses in a continuous decision-making task where reward contingency is a function of both a subject's immediate choice and his choice history. In these more complex tasks, we demonstrated that a simple actor-critic model can account for both the subjects' behavioral and brain responses, and identified a reward prediction error signal in ventral striatal structures active during these non-stationary decision tasks. However, a sudden introduction of new reward structures engages more complex control circuitry in the prefrontal cortex (inferior frontal gyrus and anterior insula) and is not captured by a simple actor-critic model. Taken together, these results extend our knowledge of reward-learning signals into more complex, history-dependent choice tasks. They also highlight the important interplay between striatum and prefrontal cortex as decision-makers respond to the strategic demands imposed by non-stationary reward environments more reminiscent of real-world tasks.
Cognitive mechanisms of learning in sequential decision-making under uncertainty: an experimental and theoretical approach

Gloria Cecchini,Michael DePass,Emre Baspinar,Marta Andujar,Surabhi Ramawat,Pierpaolo Pani,Stefano Ferraina,Alain Destexhe,Rubén Moreno-Bote,Ignasi Cos

DOI: https://doi.org/10.3389/fnbeh.2024.1399394

2024-08-12

Abstract:Learning to make adaptive decisions involves making choices, assessing their consequence, and leveraging this assessment to attain higher rewarding states. Despite vast literature on value-based decision-making, relatively little is known about the cognitive processes underlying decisions in highly uncertain contexts. Real world decisions are rarely accompanied by immediate feedback, explicit rewards, or complete knowledge of the environment. Being able to make informed decisions in such contexts requires significant knowledge about the environment, which can only be gained via exploration. Here we aim at understanding and formalizing the brain mechanisms underlying these processes. To this end, we first designed and performed an experimental task. Human participants had to learn to maximize reward while making sequences of decisions with only basic knowledge of the environment, and in the absence of explicit performance cues. Participants had to rely on their own internal assessment of performance to reveal a covert relationship between their choices and their subsequent consequences to find a strategy leading to the highest cumulative reward. Our results show that the participants' reaction times were longer whenever the decision involved a future consequence, suggesting greater introspection whenever a delayed value had to be considered. The learning time varied significantly across participants. Second, we formalized the neurocognitive processes underlying decision-making within this task, combining mean-field representations of competing neural populations with a reinforcement learning mechanism. This model provided a plausible characterization of the brain dynamics underlying these processes, and reproduced each aspect of the participants' behavior, from their reaction times and choices to their learning rates. In summary, both the experimental results and the model provide a principled explanation to how delayed value may be computed and incorporated into the neural dynamics of decision-making, and to how learning occurs in these uncertain scenarios.
Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation

Eliana Vassena,Massimo Silvetti,Carsten N. Boehler,Eric Achten,Wim Fias,Tom Verguts

DOI: https://doi.org/10.1371/journal.pone.0091008

IF: 3.7

2014-03-07

PLoS ONE

Abstract:Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.

multidisciplinary sciences
The medial prefrontal cortex leaves the hippocampus when it prepares for the future

Yixiong Sun,Kaori Takehara-Nishiuchi

DOI: https://doi.org/10.1177/00368504241261833

IF: 1.512

2024-06-16

Science Progress

Abstract:Science Progress, Volume 107, Issue 2, April-June 2024. Our memories help us plan for the future. In some cases, we use memories to repeat the choices that led to preferable outcomes in the past. The success of these memory-guided decisions depends on close interactions between the hippocampus and medial prefrontal cortex. In other cases, we need to use our memories to deduce hidden connections between the present and past situations to decide the best choice of action based on the expected outcome. Our recent study investigated neural underpinnings of such inferential decisions by monitoring neural activity in the medial prefrontal cortex and hippocampus in rats. We identified several neural activity patterns indicating awake memory trace reactivation and restructuring of functional connectivity among multiple neurons. We also found that these patterns occurred concurrently with the ongoing hippocampal activity when rats recalled past events but not when they planned new adaptive actions. Here, we discussed how these computational properties might contribute to success in inferential decision-making and propose a working model on how the medial prefrontal cortex changes its interaction with the hippocampus depending on whether it reflects on the past or looks into the future.

multidisciplinary sciences
Reward-based option competition in human dorsal stream and transition from stochastic exploration to exploitation in continuous space

Michael N Hallquist,Kai Hwang,Beatriz Luna,Alexandre Y Dombrovski,Michael N. Hallquist,Alexandre Y. Dombrovski

DOI: https://doi.org/10.1126/sciadv.adj2219

IF: 13.6

2024-02-24

Science Advances

Abstract:Primates exploring and exploiting a continuous sensorimotor space rely on dynamic maps in the dorsal stream. Two complementary perspectives exist on how these maps encode rewards. Reinforcement learning models integrate rewards incrementally over time, efficiently resolving the exploration/exploitation dilemma. Working memory buffer models explain rapid plasticity of parietal maps but lack a plausible exploration/exploitation policy. The reinforcement learning model presented here unifies both accounts, enabling rapid, information-compressing map updates and efficient transition from exploration to exploitation. As predicted by our model, activity in human frontoparietal dorsal stream regions, but not in MT+, tracks the number of competing options, as preferred options are selectively maintained on the map, while spatiotemporally distant alternatives are compressed out. When valuable new options are uncovered, posterior β 1 /α oscillations desynchronize within 0.4 to 0.7 s, consistent with option encoding by competing β 1 -stabilized subpopulations. Together, outcomes matching locally cached reward representations rapidly update parietal maps, biasing choices toward often-sampled, rewarded options.

multidisciplinary sciences
The neural substrates of probabilistic and intertemporal decision making

Bethany J. Weber,Scott A. Huettel

DOI: https://doi.org/10.1016/j.brainres.2008.07.105

IF: 3.61

2008-10-01

Brain Research

Abstract:Many important decisions involve outcomes that are either probabilistic or delayed. Based on similarities in decision preferences, models of decision making have postulated that the same psychological processes may underlie decisions involving probabilities (i.e., risky choice) and decisions involving delay (i.e., intertemporal choice). Equivocal behavioral evidence has made this hypothesis difficult to evaluate. However, a combination of functional neuroimaging and behavioral data may allow identification of differences between these forms of decision making. Here, we used functional magnetic resonance imaging (fMRI) to examine brain activation in subjects making a series of choices between pairs of real monetary rewards that differed either in their relative risk or their relative delay. While both sorts of choices evoked activation in brain systems previously implicated in executive control, we observed clear distinctions between these forms of decision making. Notably, choices involving risk evoked greater activation in posterior parietal and lateral prefrontal cortices, whereas choices involving delay evoked greater activation in the posterior cingulate cortex and the striatum. Moreover, activation of regions associated with reward evaluation predicted choices of a more-risky option, whereas activation of control regions predicted choices of more-delayed or less-risky options. These results indicate that there are differences in the patterns of brain activation evoked by risky and intertemporal choices, suggesting that the two domains utilize at least partially distinct sets of cognitive processes.

neurosciences
Impulsive Choices Emerge When the Anterior Cingulate Cortex Fails to Encode Deliberative Strategies

Shelby M. White,Mitchell D. Morningstar,Emanuela De Falco,David N. Linsenbardt,Baofeng Ma,Macedonia A. Parks,Cristine L. Czachowski,Christopher C. Lapish

DOI: https://doi.org/10.1523/eneuro.0379-24.2024

2024-11-27

eNeuro

Abstract:Impulsive individuals excessively discount the value of delayed rewards, and this is thought to reflect deficits in brain regions critical for impulse control such as the anterior cingulate cortex (ACC). Delay discounting (DD) is an established measure of cognitive impulsivity, referring to the devaluation of rewards delayed in time. This study used male Wistar rats performing a DD task to test the hypothesis that neural activity states in ACC ensembles encode strategies that guide decision-making. Optogenetic silencing of ACC neurons exclusively increased impulsive choices at the 8 s delay by increasing the number of consecutive low-value, immediate choices. In contrast to shorter delays where animals preferred the delay option, no immediate or delay preference was detected at 8 s. These data suggest that ACC was critical for decisions requiring more deliberation between choice options. To address the role of ACC in this process, large-scale multiple single-unit recordings were performed and revealed that 4 and 8 s delays were associated with procedural versus deliberative neural encoding mechanisms, respectively. The 4 and 8 s delay differed in encoding of strategy corresponding to immediate and delay run termination. Specifically, neural ensemble states at 4 s were relatively stable throughout the choice but exhibited temporal evolution in state space during the choice epoch that resembled ramping during the 8 s delay. Collectively, these findings indicate that ensemble states in ACC facilitate strategies that guide decision-making, and impulsivity increases with disruptions of deliberative encoding mechanisms.

neurosciences
Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards

Denis O'Hora,Rachel Carey,Aoife Kervick,David Crowley,Maciej Dabrowski

DOI: https://doi.org/10.1038/srep20740

2016-02-12

Abstract:People tend to discount rewards or losses that occur in the future. Such delay discounting has been linked to many behavioral and health problems, since people choose smaller short-term gains over greater long-term gains. We investigated whether the effect of delays on the subjective value of rewards is expressed in how people move when they make choices. Over 600 patrons of the RISK LAB exhibition hosted by the Science Gallery Dublin(TM) played a short computer game in which they used a computer mouse to choose between amounts of money at various delays. Typical discounting effects were observed and decision dynamics indicated that choosing smaller short-term rewards became easier (i.e., shorter response times, tighter trajectories, less vacillation) as the delays until later rewards increased. Based on a sequence of choices, subjective values of delayed outcomes were estimated and decision dynamics during initial choices predicted these values. Decision dynamics are affected by subjective values of available options and thus provide a means to estimate such values.
Balancing safety and efficiency in human decision making

Pranav Mahajan,Shuangyi Tong,Sang Wan Lee,Ben Seymour

DOI: https://doi.org/10.1101/2024.01.23.576678

2024-07-04

Abstract:The safety-efficiency dilemma describes the problem of maintaining safety during efficient exploration and is a special case of the exploration-exploitation dilemma in the face of potential dangers. Conventional exploration-exploitation solutions collapse punishment and reward into a single feedback signal, whereby early losses can be overcome by later gains. However, the brain has a separate system for Pavlovian fear learning, suggesting a possible computational advantage to maintaining a specific fear memory during exploratory decision-making. In a series of simulations, we show this promotes safe but efficient learning and is optimised by arbitrating Pavlovian avoidance of instrumental decision-making according to uncertainty. We provide a basic test of this model in a simple human approach-withdrawal experiment, and show that this flexible avoidance model captures choice and reaction times. These results show that the Pavlovian fear system has a more sophisticated role in decision-making than previously thought, by shaping flexible exploratory behaviour in a computationally precise manner.

Neuroscience
Differential phase-amplitude coupling in nucleus accumbens and orbitofrontal cortex reflects decision-making during a delay discounting task

V.H. Azocar,P. Petersson,R. Fuentes,J.A. Fuentealba

DOI: https://doi.org/10.1016/j.pnpbp.2024.111064

IF: 5.201

2024-06-26

Progress in Neuro-Psychopharmacology and Biological Psychiatry

Abstract:Background The impulsive choice is characterized by the preference for a small immediate reward over a bigger delayed one. The mechanisms underlying impulsive choices are linked to the activity in the Nucleus Accumbens (NAc), the orbitofrontal cortex (OFC), and the dorsolateral striatum (DLS). While the study of functional connectivity between brain areas has been key to understanding a variety of cognitive processes, it remains unclear whether functional connectivity differentiates impulsive-control decisions. Methods To study the functional connectivity both between and within NAc, OFC, and DLS during a delay discounting task, we concurrently recorded local field potential in NAc, OFC, and DLS in rats. We then quantified the degree of phase-amplitude coupling (PAC), coherence, and Granger Causality between oscillatory activities in animals exhibiting either a high (HI) or low (LI) tendency for impulsive choices. Results Our results showed a differential pattern of PAC during decision-making in OFC and NAc, but not in DLS. While theta-gamma PAC in OFC was associated with self-control decisions, a higher delta-gamma PAC in both OFC and NAc biased decisions toward impulsive choices in both HI and LI groups. Furthermore, during the reward event, Granger Causality analysis indicated a stronger NAc➔OFC gamma contribution in the HI group, while the LI group showed a higher OFC➔NAc gamma contribution. Conclusions The overactivity in NAc during reward in the HI group suggests that exacerbated contribution of NAcCore can lead to an overvaluation of reward that biases the behavior toward the impulsive choice.

pharmacology & pharmacy,neurosciences,psychiatry,clinical neurology
Activity of Prefrontal Neurons Predict Future Choices during Gambling

Johannes Passecker,Nace Mikus,Hugo Malagon-Vina,Philip Anner,Jordane Dimidschstein,Gordon Fishell,Georg Dorffner,Thomas Klausberger

DOI: https://doi.org/10.1016/j.neuron.2018.10.050

IF: 16.2

2019-01-01

Neuron

Abstract:Neuronal signals in the prefrontal cortex have been reported to predict upcoming decisions. Such activity patterns are often coupled to perceptual cues indicating correct choices or values of different options. How does the prefrontal cortex signal future decisions when no cues are present but when decisions are made based on internal valuations of past experiences with stochastic outcomes? We trained rats to perform a two-arm bandit-task, successfully adjusting choices between certain-small or possible-big rewards with changing long-term advantages. We discovered specialized prefrontal neurons, whose firing during the encounter of no-reward predicted the subsequent choice of animals, even for unlikely or uncertain decisions and several seconds before choice execution. Optogenetic silencing of the prelimbic cortex exclusively timed to encounters of no reward, provoked animals to excessive gambling for large rewards. Firing of prefrontal neurons during outcome evaluation signals subsequent choices during gambling and is essential for dynamically adjusting decisions based on internal valuations.

neurosciences
Neurophysiological insights into sequential decision-making: exploring the secretary problem through ERPs and TBR dynamics

Dor Mizrahi,Ilan Laufer,Inon Zuckerman

DOI: https://doi.org/10.1186/s40359-024-01750-5

2024-04-30

Abstract:Decision-making under uncertainty, a cornerstone of human cognition, is encapsulated by the "secretary problem" in optimal stopping theory. Our study examines this decision-making challenge, where participants are required to sequentially evaluate and make irreversible choices under conditions that simulate cognitive overload. We probed neurophysiological responses by engaging 27 students in a secretary problem simulation while undergoing EEG monitoring, focusing on Event-Related Potentials (ERPs) P200 and P400, and Theta to Beta Ratio (TBR) dynamics.Results revealed a nuanced pattern: the P200 component's amplitude declined from the initial to the middle offers, suggesting a diminishing attention span as participants grew accustomed to the task. This attenuation reversed at the final offer, indicating a heightened cognitive processing as the task concluded. In contrast, the P400 component's amplitude peaked at the middle offer, hinting at increased cognitive evaluation, and tapered off at the final decision. Additionally, TBR dynamics illustrated a fluctuation in attentional control and emotional regulation throughout the decision-making sequence, enhancing our understanding of the cognitive strategies employed.The research elucidates the dynamic interplay of cognitive processes in high-stakes environments, with neurophysiological markers fluctuating significantly as participants navigated sequential choices. By correlating these fluctuations with decision-making behavior, we provide insights into the evolving strategies from heightened alertness to strategic evaluation. Our findings offer insights that could inform the use of neurophysiological data in the development of decision-making frameworks, potentially contributing to the practical application of cognitive research in real-life contexts.
A common stay-on-goal mechanism in anterior cingulate cortex for information and effort choices

Valeria V Gonzalez,Melissa Malvaez,Alex Yeghikian,Sydney Wissing,Melissa Sharpe,Kate M Wassum,Alicia Izquierdo

DOI: https://doi.org/10.1101/2024.10.23.619920

2024-10-23

Abstract:Humans and non-humans alike often make choices to gain information, even when the information cannot be used to change the outcome. Prior research has shown the anterior cingulate cortex (ACC) is important for evaluating options involving reward-predictive information. Here we studied the role of ACC in information choices using optical inhibition to evaluate the contribution of this region during specific epochs of decision making. Rats could choose between an uninformative option followed by a cue that predicted reward 50% of the time vs. a fully informative option that signaled outcomes with certainty, but was rewarded only 20% of the time. Reward seeking during the informative S+ cue decreased following ACC inhibition, indicating a causal contribution of this region in supporting reward expectation to a cue signaling reward with certainty. Separately in a positive control experiment and in support of a known role for this region in sustaining high-effort behavior for preferred rewards, we observed reduced lever presses and lower breakpoints in effort choices following ACC inhibition. The lack of changes in reward latencies in both types of decisions indicate the motivational value of rewards remained intact, revealing instead a common role for ACC in maintaining persistence toward certain and valuable rewards.

Neuroscience
Neural representations of the amount and the delay time of reward in intertemporal decision making

Qiang Wang,Yajie Wang,Pinchun Wang,Maomiao Peng,Manman Zhang,Yuxuan Zhu,Shiyu Wei,Chuansheng Chen,Xiongying Chen,Shan Luo,Xuejun Bai

DOI: https://doi.org/10.1002/hbm.25445

IF: 4.8

2021-05-02

Human Brain Mapping

Abstract:<p>Numerous studies have examined the neural substrates of intertemporal decision‐making, but few have systematically investigated separate neural representations of the two attributes of future rewards (i.e., the amount of the reward and the delay time). More importantly, no study has used the novel analytical method of representational connectivity analysis (RCA) to map the two dimensions' functional brain networks at the level of multivariate neural representations. This study independently manipulated the amount and delay time of rewards during an intertemporal decision task. Both univariate and multivariate pattern analyses showed that brain activity in the dorsomedial prefrontal cortex (DMPFC) and lateral frontal pole cortex (LFPC) was modulated by the amount of rewards, whereas brain activity in the DMPFC and dorsolateral prefrontal cortex (DLPFC) was modulated by the length of delay. Moreover, representational similarity analysis (RSA) revealed that even for the regions of the DMPFC that overlapped between the two dimensions, they manifested distinct neural activity patterns. In terms of individual differences, those with large delay discounting rates (k) showed greater DMPFC and LFPC activity as the amount of rewards increased but showed lower DMPFC and DLPFC activity as the delay time increased. Lastly, RCA suggested that the topological metrics (i.e., global and local efficiency) of the functional connectome subserving the delay time dimension inversely predicted individual discounting rate. These findings provide novel insights into neural representations of the two attributes in intertemporal decisions, and offer a new approach to construct task‐based functional brain networks whose topological properties are related to impulsivity.</p>

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task

Kristen D Onos,Miranda J Francoeur,Benjamin A Wormwood,Rikki L A Miller,Brett M Gibson,Robert G Mair

DOI: https://doi.org/10.1371/journal.pone.0149019

IF: 3.7

2016-02-05

PLoS ONE

Abstract:To respond adaptively to change organisms must utilize information about recent events and environmental context to select actions that are likely to produce favorable outcomes. We developed a dynamic delayed nonmatching to position task to study the influence of spatial context on event-related activity of medial prefrontal cortex neurons during reinforcement-guided decision-making. We found neurons with responses related to preparation, movement, lever press responses, reinforcement, and memory delays. Combined event-related and video tracking analyses revealed variability in spatial tuning of neurons with similar event-related activity. While all correlated neurons exhibited spatial tuning broadly consistent with relevant task events, for instance reinforcement-related activity concentrated in locations where reinforcement was delivered, some had elevated activity in more specific locations, for instance reinforcement-related activity in one of several locations where reinforcement was delivered. Timing analyses revealed a limited set of distinct response types with activity time-locked to critical behavioral events that represent the temporal organization of dDNMTP trials. Our results suggest that reinforcement-guided decision-making emerges from discrete populations of medial prefrontal neurons that encode information related to planned or ongoing movements and actions and anticipated or actual action-outcomes in conjunction with information about spatial context.
Persistent Decision-Making in Mice, Monkeys, and Humans

Veldon-James Laurie,Akram Shourkeshti,Cathy S. Chen,Alexander B. Herman,Nicola M. Grissom,R. Becket Ebitz

DOI: https://doi.org/10.1101/2024.05.07.592970

2024-05-08

Abstract:Humans have the capacity to persist in behavioural policies, even in challenging environments that lack immediate reward. Our persistence is the scaffold on which many higher executive functions are built. However, it remains unclear whether humans are uniquely persistent or, instead, if this capacity is widely conserved across species. To address this question, we compared humans with mice and monkeys in harmonised versions of an uncertain decision-making task. The task encouraged all species to strike a balance between persistently exploiting one policy and exploring alternative policies that could become better at any moment. Although all three species had similar strategies, we found that both primate species—humans and monkeys—were able to persist in exploitation for much longer than the mice. We speculate that the similarities in persistence patterns in humans and monkeys, as opposed to mice, may be linked to ecological, neurobiological, or cognitive factors that differ systematically between these species.

Animal Behavior and Cognition

Naphthylalkyl lactamimides as inhibitors of blood platelet aggregation.

Intertemporal Decision-Making Involves Prefrontal Control Mechanisms Associated with Working Memory

Executive control by fronto-parietal activity explains counterintuitive decision behavior in complex value-based decision-making

Percutaneous penetration kinetics of lidocaine and prilocaine in two local anesthetic formulations assessed by in vivo microdialysis in pigs.

A role for the midbrain reticular formation in delay-based decision making

Policy adjustment in a dynamic economic game

Cognitive mechanisms of learning in sequential decision-making under uncertainty: an experimental and theoretical approach

Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation

The medial prefrontal cortex leaves the hippocampus when it prepares for the future

Reward-based option competition in human dorsal stream and transition from stochastic exploration to exploitation in continuous space

The neural substrates of probabilistic and intertemporal decision making

Impulsive Choices Emerge When the Anterior Cingulate Cortex Fails to Encode Deliberative Strategies

Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards

Balancing safety and efficiency in human decision making

Differential phase-amplitude coupling in nucleus accumbens and orbitofrontal cortex reflects decision-making during a delay discounting task

Activity of Prefrontal Neurons Predict Future Choices during Gambling

Neurophysiological insights into sequential decision-making: exploring the secretary problem through ERPs and TBR dynamics

A common stay-on-goal mechanism in anterior cingulate cortex for information and effort choices

Neural representations of the amount and the delay time of reward in intertemporal decision making

Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task

Persistent Decision-Making in Mice, Monkeys, and Humans