Inhibition by etorphine of the discharge of dorsal horn neurons: Effects on the neuronal response to both high- and low-threshold sensory input in the decerebrate spinal cat

T. Yaksh

DOI: https://doi.org/10.1016/0014-4886(78)90166-8

IF: 5.62

1978-05-15

Experimental Neurology

Abstract:

What problem does this paper attempt to address?

Dopaminergic signaling of uncertainty and the aetiology of gambling addiction

Martin Zack,Ross St George,Luke Clark,Ross St. George

DOI: https://doi.org/10.1016/j.pnpbp.2019.109853

2020-04-01

Abstract:Although there is increasing clinical recognition of behavioral addictions, of which gambling disorder is the prototype example, there is a limited understanding of the psychological properties of (non-substance-related) behaviors that enable them to become 'addictive' in a way that is comparable to drugs of abuse. According to an influential application of reinforcement learning to substance addictions, the direct effects of drugs to release dopamine can create a perpetual escalation of incentive salience. This article focusses on reward uncertainty, which is proposed to be the core feature of gambling that creates the capacity for addiction. We describe the neuro-dynamics of the dopamine response to uncertainty that may allow a similar escalation of incentive salience, and its relevance to behavioral addictions. We review translational evidence from both preclinical animal models and human clinical research, including studies in people with gambling disorder. Further, we describe the evidence for 1) the effects of the omission of expected reward as a stressor and to promote sensitization, 2) the effect of the resolution of reward uncertainty as a source of value, 3) structural characteristics of modern Electronic Gaming Machines (EGMs) in leveraging these mechanisms, 4) analogies to the aberrant salience hypothesis of psychosis for creating and maintaining gambling-related cognitive distortions. This neurobiologically-inspired model has implications for harm profiling of other putative behavioral addictions, as well as offering avenues for enhancing neurological, pharmacological and psychological treatments for gambling disorder, and harm reduction strategies for EGM design.

pharmacology & pharmacy,neurosciences,psychiatry,clinical neurology
Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

Dimitri Ognibene,Vincenzo G Fiore,Xiaosi Gu

DOI: https://doi.org/10.1016/j.neunet.2019.04.022

Abstract:Several decision-making vulnerabilities have been identified as underlying causes for addictive behaviours, or the repeated execution of stereotyped actions despite their adverse consequences. These vulnerabilities are mostly associated with brain alterations caused by the consumption of substances of abuse. However, addiction can also happen in the absence of a pharmacological component, such as seen in pathological gambling and videogaming. We use a new reinforcement learning model to highlight a previously neglected vulnerability that we suggest interacts with those already identified, whilst playing a prominent role in non-pharmacological forms of addiction. Specifically, we show that a dual-learning system (i.e. combining model-based and model-free) can be vulnerable to highly rewarding, but suboptimal actions, that are followed by a complex ramification of stochastic adverse effects. This phenomenon is caused by the overload of the capabilities of an agent, as time and cognitive resources required for exploration, deliberation, situation recognition, and habit formation, all increase as a function of the depth and richness of detail of an environment. Furthermore, the cognitive overload can be aggravated due to alterations (e.g. caused by stress) in the bounded rationality, i.e. the limited amount of resources available for the model-based component, in turn increasing the agent's chances to develop or maintain addictive behaviours. Our study demonstrates that, independent of drug consumption, addictive behaviours can arise in the interaction between the environmental complexity and the biologically finite resources available to explore and represent it.
Risk-Taking in Disorders of Natural and Drug Rewards: Neural Correlates and Effects of Probability, Valence, and Magnitude

Valerie Voon,Laurel S Morris,Michael A Irvine,Christian Ruck,Yulia Worbe,Katherine Derbyshire,Vladan Rankov,Liana RN Schreiber,Brian L Odlaug,Neil A Harrison,Jonathan Wood,Trevor W Robbins,Edward T Bullmore,Jon E Grant

DOI: https://doi.org/10.1038/npp.2014.242

2014-01-01

Neuropsychopharmacology

Abstract:Pathological behaviors toward drugs and food rewards have underlying commonalities. Risk-taking has a fourfold pattern varying as a function of probability and valence leading to the nonlinearity of probability weighting with overweighting of small probabilities and underweighting of large probabilities. Here we assess these influences on risk-taking in patients with pathological behaviors toward drug and food rewards and examine structural neural correlates of nonlinearity of probability weighting in healthy volunteers. In the anticipation of rewards, subjects with binge eating disorder show greater risk-taking, similar to substance-use disorders. Methamphetamine-dependent subjects had greater nonlinearity of probability weighting along with impaired subjective discrimination of probability and reward magnitude. Ex-smokers also had lower risk-taking to rewards compared with non-smokers. In the anticipation of losses, obesity without binge eating had a similar pattern to other substance-use disorders. Obese subjects with binge eating also have impaired discrimination of subjective value similar to that of the methamphetamine-dependent subjects. Nonlinearity of probability weighting was associated with lower gray matter volume in dorsolateral and ventromedial prefrontal cortex and orbitofrontal cortex in healthy volunteers. Our findings support a distinct subtype of binge eating disorder in obesity with similarities in risk-taking in the reward domain to substance use disorders. The results dovetail with the current approach of defining mechanistically based dimensional approaches rather than categorical approaches to psychiatric disorders. The relationship to risk probability and valence may underlie the propensity toward pathological behaviors toward different types of rewards.
Cue-Reactive Phenomenology Mediates the Relationship Between Positive Schizotypy and Cue-Reactive Urge to Gamble in Poker-Machine Gamblers

Benjamin A. McTigue,Andrew C. Talk,Kylie Rice,Adam J. Rock

DOI: https://doi.org/10.1007/s10899-024-10310-w

2024-05-11

Journal of Gambling Studies

Abstract:Although ubiquitous in numerous nightlife cultures, poker-machines present a high risk for problematic use and addiction. Previous research has demonstrated that gambling cues (e.g., flashing lights) can activate gambling urges in poker-machine gamblers. However, the processes that contribute to the maintenance of cue-reactive urges to gamble remain unclear. Consequently, the present study explored whether positive schizotypy predicted gambling urge, and whether cue-reactive altered state of awareness, cue-reactive altered time sense, and cue-reactive absorption mediated this relationship. Seventy adults aged between 19 and 68 ( M = 48.86, SD = 12.82) participated in an online cue-reactivity experiment. Participants first completed the Problem Gambling Severity Index and the Unusual Experiences subscale of the Short Oxford-Liverpool Inventory of Feelings and Experiences . Subsequently, at three time points (i.e., baseline, directly after a neutral cue, and directly after a gambling cue) participants completed the Altered State of Awareness, Altered Time Sense, and Absorption subscales of the Phenomenology of Consciousness Inventory and a visual analogue scale measuring cue-reactive urge to gamble. It was found that positive schizotypy was significantly positively correlated with cue-reactive urge to gamble. Additionally, cue-reactive altered state of awareness, cue-reactive altered time sense, and cue-reactive absorption mediated this relationship. The theoretical, clinical and practical implications are discussed.

psychology, multidisciplinary,substance abuse
Decomposition of Reinforcement Learning Deficits in Disordered Gambling via Drift Diffusion Modeling and Functional Magnetic Resonance Imaging

Antonius Wiehler,Jan Peters

DOI: https://doi.org/10.5334/cpsy.104

2024-03-20

Abstract:Gambling disorder is associated with deficits in reward-based learning, but the underlying computational mechanisms are still poorly understood. Here, we examined this issue using a stationary reinforcement learning task in combination with computational modeling and functional resonance imaging (fMRI) in individuals that regular participate in gambling (n = 23, seven fulfilled one to three DSM 5 criteria for gambling disorder, sixteen fulfilled four or more) and matched controls (n = 23). As predicted, the gambling group exhibited substantially reduced accuracy, whereas overall response times (RTs) were not reliably different between groups. We then used comprehensive modeling using reinforcement learning drift diffusion models (RLDDMs) in combination with hierarchical Bayesian parameter estimation to shed light on the computational underpinnings of this performance deficit. In both groups, an RLDDM in which both non-decision time and decision threshold (boundary separation) changed over the course of the experiment accounted for the data best. The model showed good parameter and model recovery, and posterior predictive checks revealed that, in both groups, the model accurately reproduced the evolution of accuracies and RTs over time. Modeling revealed that, compared to controls, the learning impairment in the gambling group was linked to a more rapid reduction in decision thresholds over time, and a reduced impact of value-differences on the drift rate. The gambling group also showed shorter non-decision times. FMRI analyses replicated effects of prediction error coding in the ventral striatum and value coding in the ventro-medial prefrontal cortex, but there was no credible evidence for group differences in these effects. Taken together, our findings show that reinforcement learning impairments in disordered gambling are linked to both maladaptive decision threshold adjustments and a reduced consideration of option values in the choice process.
Craving money? Evidence from the laboratory and the field

Elise Payzan-LeNestour,James Doran

DOI: https://doi.org/10.1126/sciadv.adi5034

IF: 13.6

2024-01-13

Science Advances

Abstract:Continuing to gamble despite harmful consequences has plagued human life in many ways, from loss-chasing in problem gamblers to reckless investing during stock market bubbles. Here, we propose that these anomalies in human behavior can sometimes reflect Pavlovian perturbations on instrumental behavior. To show this, we combined key elements of Pavlovian psychology literature and standard economic theory into a single model. In it, when a gambling cue such as a gaming machine or a financial asset repeatedly delivers a good outcome, the agent may start engaging with the cue even when the expected value is negative. Next, we transported the theoretical framework into an experimental task and found that participants behaved like the agent in our model. Last, we applied the model to the domain of real-world financial trading and discovered an asset-pricing anomaly suggesting that market participants are susceptible to the purported Pavlovian bias.

multidisciplinary sciences
Risk taking in disorders of natural and drug rewards

Valerie Voon,Laurel S Morris,Michael A Irvine,Christian Ruck,Yulia Worbe,Katherine Derbyshire,Vladan Rankov,Liana Rn Schreiber,Brian Lawrence Odlaug,Neil A Harrison,Jonathan Wood,Trevor W Robbins,Edward T Bullmore,Jon E Grant

2015-01-01

Abstract:Pathological behaviors toward drugs and food rewards have underlying commonalities. Risk-taking has a fourfold pattern varying as a function of probability and valence leading to the nonlinearity of probability weighting with overweighting of small probabilities and underweighting of large probabilities. Here we assess these influences on risk-taking in patients with pathological behaviors toward drug and food rewards and examine structural neural correlates of nonlinearity of probability weighting in healthy volunteers. In the anticipation of rewards, subjects with binge eating disorder show greater risk-taking, similar to substance-use disorders. Methamphetamine-dependent subjects had greater nonlinearity of probability weighting along with impaired subjective discrimination of probability and reward magnitude. Ex-smokers also had lower risk-taking to rewards compared with non-smokers. In the anticipation of losses, obesity without binge eating had a similar pattern to other substance-use disorders. Obese subjects with binge eating also have impaired discrimination of subjective value similar to that of the methamphetamine-dependent subjects. Nonlinearity of probability weighting was associated with lower gray matter volume in dorsolateral and ventromedial prefrontal cortex and orbitofrontal cortex in healthy volunteers. Our findings support a distinct subtype of binge eating disorder in obesity with similarities in risk-taking in the reward domain to substance use disorders. The results dovetail with the current approach of defining mechanistically based dimensional approaches rather than categorical approaches to psychiatric disorders. The …
The Influence of Gambling on Mood State and Alcohol Cravings

Damon Lipinski,James P Whelan,Blaine E Stiglets,Meredith K Ginley,Rory A Pfund

DOI: https://doi.org/10.1007/s10899-023-10265-4

Abstract:Several decades of research have experimentally investigated the influence of alcohol on gambling. However, there has been only minimal experimental exploration of how gambling influences alcohol use. The aim of the current project was to evaluate how gambling influenced mood state and alcohol cravings through randomized experimental design when analyzed with comparison conditions.College students (N = 76) who reported regular alcohol use, gambling within the past year, and being college basketball fans were randomly assigned to watch a video of an exciting basketball game, watch a nondysphoric basketball game, watch a movie, or engage in slot machine gambling. Participants who watched exciting sports or engaged in gambling to reported more energized mood states and higher urges to drink compared to those who watched nondysphoric sports or a movie. These results suggest that the context of gambling may prime individuals to want to consume alcohol.
Biased choice and incentive salience: Implications for addiction.

Mike E. Le Pelley,Poppy Watson,Reinout W. Wiers

DOI: https://doi.org/10.1037/bne0000583

2024-09-10

Behavioral Neuroscience

Abstract:Before we can make any choice, we must gather information from the environment about what our options are. This information-gathering process is critically mediated by attention, and our attention is, in turn, shaped by our previous experiences with—and learning about—stimuli and their consequences. In this review, we highlight studies demonstrating a rapid and automatic influence of reward learning on attentional capture and argue that these findings provide a human analog of sign-tracking behavior observed in nonhuman animals—wherein signals of reward gain incentive salience and become attractive targets for attention (and overt behavior) in their own right. We then consider the implications of this idea for understanding the drivers of cue-controlled behavior, with focus on addiction as a case in which choices with regard to reward-related stimuli can become injurious to health. We argue that motivated behavior in general—and addiction in particular—can be understood within a "biased competition" framework: Different options and outcomes compete for attentional priority as a function of top–down goals, bottom–up salience, and prior experience, and the winner of this competition becomes the target for subsequent outcome-directed and flexible behavior. Finally, we outline the implications of the biased-competition framework for cognitive, behavioral, and socioeconomic interventions for addiction. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

behavioral sciences,neurosciences
Gambling disorder is associated with reduced sensitivity to expected value during risky choice

Eve H Limbrick-Oldfield,Mariya V Cherkasova,Dawn Kennedy,Caylee-Britt Goshko,Dale Griffin,Jason J S Barton,Luke Clark

DOI: https://doi.org/10.1556/2006.2020.00088

2020-11-26

Abstract:Background and aims: Individuals with gambling disorder display increased levels of risk-taking, but it is not known if it is associated with an altered subjective valuation of gains and/or losses, perception of their probabilities, or integration of these sources of information into expected value. Methods: Participants with gambling disorder (n = 48) were compared with a healthy comparison group (n = 35) on a two-choice lottery task that involved either gains-only or losses-only gambles. On each trial, two lotteries were displayed, showing the associated probability and magnitude of the possible outcome for each. On each trial, participants chose one of the two lotteries, and the outcome was revealed. Results: Choice behaviour was highly sensitive to the expected value of the two gambles in both the gain and loss domains. This sensitivity to expected value was attenuated in the group with gambling disorder. The group with gambling disorder used both probability and magnitude information less, and this impairment was greater for probability information. By contrast, they used prior feedback (win vs loss) to inform their next choice, despite the independence of each trial. Within the gambling disorder group, problem gambling severity and trait gambling-related cognitions independently predicted reduced sensitivity to expected value. The majority of observed effects were consistent across both gain and loss domains. Discussion and conclusions: Our results provide a thorough characterization of decision processes in gain and loss domains in gambling disorder, and place these problems in the context of theoretical constructs from behavioural economics.
'I Can Tell You It's a Bit of a Gamble': A Qualitative Analysis of How People Who Engage in Gaming and Gambling Understand a Link Between These Two Behaviours

Łukasz Wieczorek,M Bujalski,K Dąbrowska

DOI: https://doi.org/10.1007/s10899-023-10275-2

Abstract:This article explores the attention given to potential motives and determinants of the transition process from video games to gambling. Forty individual interviews were conducted among active video game players (n = 20), and people diagnosed with a gambling disorder who had the experience of playing video games (n = 20). A qualitative thematic analysis was employed to explore the collected empirical data. The range of factors considered responsible for the transition from playing video games to gambling included experiencing similar emotional states, the presence of gambling in video games, advertising of gambling companies in video games, loot boxes. The awareness of factors associated with the development of gambling disorders among video game players has an important role in informing prevention policies in the rapidly changing video gaming and gambling market. Decision-makers should introduce effective regulation of the use of gambling components in video games to protect gamers against the gambling-related harm.
Altered neural responses to missed chance contribute to the risk‐taking behaviour in individuals with Internet gaming disorder

Zhiyuan Liu,Pujiang Huang,Yue Gong,Yifan Wang,Yuyan Wu,Chenggong Wang,Xiuyan Guo

DOI: https://doi.org/10.1111/adb.13124

2021-12-11

Addiction Biology

Abstract:Missed chance is a powerful factor in shaping risk-taking behaviour. The abnormal risk-taking behaviour is an obvious feature of individuals with Internet gaming disorder (IGD). However, the relationship between the neural responses to missed chance and risk-taking behaviour in IGD individuals remains unclear. In the current fMRI study, 28 IGD subjects (12 female, 23.04 ± 2.43 years old) and 26 healthy control (HC) subjects (13 female, 23.58 ± 2.67 years old) participated in fMRI scanning during performance of a sequential risk-taking task. The general linear model and the psycho-physiological interaction analyses were conducted to explore the difference in neural responses between the two groups. The results showed that IGD subjects reported more regret for the large missed chance and took more risk than HC subjects. Moreover, compared with HC subjects, IGD subjects exhibited greater activations in brain regions like ventral striatum (VS) and superior frontal gyrus (SFG), and stronger VS-thalamus functional connectivity for the large missed chance. Additionally, among IGD subjects, the SFG activation for the large missed chance was positively correlated with the risk-taking behaviour. Together, the results revealed the altered neural responses to missed chance contributed to the risk-taking behaviour in IGD individuals. The findings could help to clearly understand why IGD individuals continue playing online games despite the risks of widely known and could provide a new perspective for the intervention of IGD.

biochemistry & molecular biology,substance abuse
Reward circuitry dopaminergic activation regulates food and drug craving behavior

Kenneth Blum,Yijun Liu,Richard Shriner,Mark S Gold

DOI: https://doi.org/10.2174/138161211795656819

Abstract:Neural circuits implicated in drug conditioning, craving and relapse overlap extensively with those involved in natural reward and reinforcement like food. Exposure to drug-related cues in human addicts results in drug craving and localized activation of central circuits that are known to mediate cue-induced reinstatement of drug-seeking behavior in animal models of relapse. Similar regional activation patterns occur in humans in response to cues associated with foods. Furthermore, drug- and food-related cues not only activate common neuroanatomical regions but also result in similar activity-regulated gene expression programs within these shared areas. Cues predictive of food availability are powerful modulators of appetite as well as food-seeking and ingestive behaviors. The upregulation of a number of early genes in unique patterns within corticostriatal, thalamic, and hypothalamic networks suggests that food cues are capable of powerfully altering neuronal processing in areas mediating the integration of emotion, cognition, arousal, and the regulation of energy balance. The dopaminergic, enkephalinergic, and fos gene expressions are important regulatory genetic pathways for food craving behaviors. An umbrella term to describe common genetic antecedents of multiple impulsive, compulsive and addictive behaviors is Reward Deficiency Syndrome (RDS). Individuals possessing a paucity of serotonergic and/or dopaminergic receptors and an increased rate of synaptic dopamine catabolism, due to high catabolic genotype of the COMT gene, are predisposed to self-medicating any substance or behavior that will activate dopamine release including alcohol, opiates, psychostimulants, nicotine, glucose, gambling, sex, and even excessive internet gaming, among others. Finally, utilizing the long term dopaminergic activation approach will ultimately lead to a common safe and effective modality to treat RDS behaviors including aberrant food and drug craving behaviors.
A generalizable computational mechanism underlying the interaction between momentary craving and decision-making

Kaustubh R Kulkarni,Laura A Berner,Shawn A Rhoads,Vincenzo G Fiore,Daniela Schiller,Xiaosi Gu

DOI: https://doi.org/10.1101/2023.04.24.538109

2024-10-02

Abstract:Substance craving and maladaptive choices are intertwined across addictive disorders. However, the computational mechanisms connecting craving and decision-making remain elusive. Here, we tested a hypothesis that momentary craving and value-based decision-making influence each other during substance-related reinforcement learning. We measured momentary craving as two groups of human participants (alcohol drinkers and cannabis users; total n=132) performed a reinforcement learning task in which they received group-specific addictive cue or monetary rewards. Using computational modeling, we found that, across both groups, momentary craving biased learning rate related to substance-associated prediction errors (RPEs), but not monetary RPEs. Additionally, expected values and RPEs jointly influenced elicited craving across reward types and participant groups. Alcohol and cannabis users also differed in the extent to which their craving and decision-making influenced each other, suggesting important computational divergence between the two groups. Finally, regressions incorporating model-derived parameters best predicted substance use severity in the alcohol, but not cannabis group, supporting the utility of using these model-based parameters in making clinical predictions for selective substance groups. Together, these findings provide a computational mechanism for the interaction between substance craving and maladaptive choices that is generalizable across addictive domains.

Neuroscience
Getting even: chasing behavior, decision-making, and craving in habitual gamblers

Marina Cosenza,Mariagiulia Sacco,Maria Ciccarelli,Barbara Pizzini,Susana Jiménez-Murcia,Fernando Fernández-Aranda,Giovanna Nigro

DOI: https://doi.org/10.1186/s40359-024-01911-6

2024-08-19

Abstract:Background: Dysfunctional decision-making and intense craving represent pivotal aspects across all addictive behaviors, notably evident in gambling addiction where these factors significantly shape chasing behavior-continuing gambling to recoup losses-indicative of problematic gambling. This study explores the correlation between chasing behavior, craving, affective decision-making, decision-making styles, and gambling severity among habitual Italian gamblers. Methods: One hundred and sixty-six participants from diverse gambling venues completed assessments including the South Oaks Gambling Screen (SOGS), the Iowa Gambling Task (IGT), the General Decision-Making Style (GDMS), the Gambling Craving Scale (GACS), and a computerized task to measure chasing behavior. Participants were randomly assigned to Control and Loss chasing conditions. Results: Regression analyses revealed craving as a predictor of chasing behavior. Interestingly, individuals with a dependent decision-making style exhibited lower tendencies to chase. While IGT performance correlates with chasing frequency, it is not associated with the decision to continue or cease gambling. Intriguingly, gambling severity (SOGS total score) did not feature in the final models of both regression analyses. Discussion: These findings emphasize the significant role of craving in driving chasing behavior. Additionally, this study introduces, for the first time, the idea that a dependent decision-making style could potentially serve as a safeguard against chasing proneness. Conclusions: The study suggests a fundamental dichotomy between chasers and nonchasers among gamblers, irrespective of gambling severity. This distinction could be instrumental in tailoring more effective intervention strategies for gambling disorder treatment.
Porifera: Sudden Sperm Release by Tropical Demospongiae

H. Reiswig

DOI: https://doi.org/10.1126/SCIENCE.170.3957.538

IF: 56.9

1970-10-30

Science

Abstract:Three tropical marine demosponges inhabiting the deep coral reefs of Jamaica expel immense clouds of milky fluid from exhalant apertures. Analysis of samples shows this fluid to contain mature male gametes. The behavior is an individual or a population event in different species.
From game engagement to craving responses - The role of gratification and compensation experiences during video-gaming in casual and at-risk gamers

S Antons,M Liebherr,M Brand,A Brandtner

DOI: https://doi.org/10.1016/j.abrep.2023.100520

2023-11-30

Abstract:Introduction: Although playing videogames is a common leisure activity some individuals develop problematic gaming behaviors or even symptoms of a gaming disorder. Game engagement may be involved in reinforcement learning that may result in experiences of craving, an important feature of gaming disorder. In the following study we aimed to approach the question which aspects contribute to increased craving for gaming. Methods: Overall, 439 individuals participated in an online survey, answering questionnaires on game engagement, experience of gratification and compensation, craving, and symptoms of gaming disorder. A mediation model testing if the association between game engagement and facets of craving are mediated by the experience of gratification and compensation during gaming. Results: Three facets of craving (reward/relief, physiological, obsessive craving) were statistically explained by game engagement and the experience of gratification and compensation. Models differed between casual gamers and at-risk gamers. The effects on reward/relief and physiological craving were fully mediated in the casual group and partially mediated in the at-risk group by gratification and compensation experiences. Conclusion: Game engagement may contribute to the development of craving by increasing the experience of gratification and compensation and thus might be important in reinforcement learning. Games evoking a high engagement may therefore have a higher addictive potential. Further processes potentially related to game engagement, such as intrusive thoughts and desire thinking, which are related to craving experiences, should be considered in future studies.
Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

Katharina Zühlsdorff,Juan Verdejo-Román,Luke Clark,Natalia Albein-Urios,Carles Soriano-Mas,Rudolf N. Cardinal,Trevor W. Robbins,Jeffrey W. Dalley,Antonio Verdejo-García,Jonathan W. Kanen

DOI: https://doi.org/10.1101/2023.03.06.531272

2023-01-01

Abstract:Cognitive flexibility refers to the ability to adjust to changes in the environment and is essential for adaptive behavior. It can be investigated using laboratory tests such as probabilistic reversal learning (PRL). In individuals with both Cocaine Use Disorder (CUD) and Gambling Disorder (GD), overall impairments in PRL flexibility are observed. However, it is poorly understood whether this impairment depends on the same brain mechanisms in cocaine and gambling addictions. Reinforcement learning (RL) is the process by which rewarding or punishing feedback from the environment is used to adjust behavior, to maximise reward and minimise punishment. Using RL models, a deeper mechanistic explanation of the latent processes underlying cognitive flexibility can be gained. Here, we report results from a re-analysis of PRL data from control participants (n=18) and individuals with either GD (n=18) or CUD (n=20) using a hierarchical Bayesian RL approach. We observed significantly reduced ‘stimulus stickiness’ (i.e., stimulus-bound perseveration) in GD, which may reflect increased exploratory behavior that is insensitive to outcomes. RL parameters were unaffected in CUD. We relate the behavioral findings to their underlying neural substrates through an analysis of task-based fMRI data. We report differences in tracking reward and punishment expected values (EV) in individuals with GD compared to controls, with greater activity during reward EV tracking in the cingulate gyrus and amygdala. In CUD, we observed reduced responses to positive punishment prediction errors (PPE) and increased activity following negative PPEs in the superior frontal gyrus compared to controls. Thus, an RL framework serves to differentiate behavior in a probabilistic learning paradigm in two compulsive disorders, GD and CUD. ### Competing Interest Statement The Centre for Gambling Research at UBC (L.C.) is funded by support from the Province of British Columbia and the British Columbia Lottery Corporation. J.W.D. has received research grants from Boehringer Ingelheim Pharma GmbH and GlaxoSmithKline and receives royalties from Springer Verlag. T.W.R. discloses consultancy with Cambridge Cognition; he receives editorial honoraria from Springer-Nature and Elsevier and a research grant from Shionogi. R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press.
Reward Sensitivity and Waiting Impulsivity: Shift Towards Reward Valuation Away from Action Control.

Daisy J Mechelmans,Daniela Strelchuk,Nuria Doñamayor,Paula Banca,Trevor W Robbins,Kwangyeol Baek,Valerie Voon

DOI: https://doi.org/10.1093/ijnp/pyx072

2017-01-01

The International Journal of Neuropsychopharmacology

Abstract:Background:Impulsivity and reward expectancy are commonly interrelated. Waiting impulsivity, measured using the rodent 5-Choice Serial Reaction Time task, predicts compulsive cocaine seeking and sign (or cue) tracking. Here, we assess human waiting impulsivity using a novel translational task, the 4-Choice Serial Reaction Time task, and the relationship with reward cues.Methods:Healthy volunteers (n=29) performed the monetary incentive delay task as a functional MRI study where subjects observe a cue predicting reward (cue) and wait to respond for high (£5), low (£1), or no reward. Waiting impulsivity was tested with the 4-Choice Serial Reaction Time task.Results:For high reward prospects (£5, no reward), greater waiting impulsivity on the 4-CSRT correlated with greater medial orbitofrontal cortex and lower supplementary motor area activity to cues. In response to high reward cues, greater waiting impulsivity was associated with greater subthalamic nucleus connectivity with orbitofrontal cortex and greater subgenual cingulate connectivity with anterior insula, but decreased connectivity with regions implicated in action selection and preparation.Conclusion:These findings highlight a shift towards regions implicated in reward valuation and a shift towards compulsivity away from higher level motor preparation and action selection and response. We highlight the role of reward sensitivity and impulsivity, mechanisms potentially linking human waiting impulsivity with incentive approach and compulsivity, theories highly relevant to disorders of addiction.
Individuals with problem gambling and obsessive-compulsive disorder learn through distinct reinforcement mechanisms

Shinsuke Suzuki,Xiaoliu Zhang,Amir Dezfouli,Leah Braganza,Ben D Fulcher,Linden Parkes,Leonardo F Fontenelle,Ben J Harrison,Carsten Murawski,Murat Yücel,Chao Suo

DOI: https://doi.org/10.1371/journal.pbio.3002031

2023-03-14

Abstract:Obsessive-compulsive disorder (OCD) and pathological gambling (PG) are accompanied by deficits in behavioural flexibility. In reinforcement learning, this inflexibility can reflect asymmetric learning from outcomes above and below expectations. In alternative frameworks, it reflects perseveration independent of learning. Here, we examine evidence for asymmetric reward-learning in OCD and PG by leveraging model-based functional magnetic resonance imaging (fMRI). Compared with healthy controls (HC), OCD patients exhibited a lower learning rate for worse-than-expected outcomes, which was associated with the attenuated encoding of negative reward prediction errors in the dorsomedial prefrontal cortex and the dorsal striatum. PG patients showed higher and lower learning rates for better- and worse-than-expected outcomes, respectively, accompanied by higher encoding of positive reward prediction errors in the anterior insula than HC. Perseveration did not differ considerably between the patient groups and HC. These findings elucidate the neural computations of reward-learning that are altered in OCD and PG, providing a potential account of behavioural inflexibility in those mental disorders.

Inhibition by etorphine of the discharge of dorsal horn neurons: Effects on the neuronal response to both high- and low-threshold sensory input in the decerebrate spinal cat

Dopaminergic signaling of uncertainty and the aetiology of gambling addiction

Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

Risk-Taking in Disorders of Natural and Drug Rewards: Neural Correlates and Effects of Probability, Valence, and Magnitude

Cue-Reactive Phenomenology Mediates the Relationship Between Positive Schizotypy and Cue-Reactive Urge to Gamble in Poker-Machine Gamblers

Decomposition of Reinforcement Learning Deficits in Disordered Gambling via Drift Diffusion Modeling and Functional Magnetic Resonance Imaging

Craving money? Evidence from the laboratory and the field

Risk taking in disorders of natural and drug rewards

The Influence of Gambling on Mood State and Alcohol Cravings

Biased choice and incentive salience: Implications for addiction.

Gambling disorder is associated with reduced sensitivity to expected value during risky choice

'I Can Tell You It's a Bit of a Gamble': A Qualitative Analysis of How People Who Engage in Gaming and Gambling Understand a Link Between These Two Behaviours

Altered neural responses to missed chance contribute to the risk‐taking behaviour in individuals with Internet gaming disorder

Reward circuitry dopaminergic activation regulates food and drug craving behavior

A generalizable computational mechanism underlying the interaction between momentary craving and decision-making

Getting even: chasing behavior, decision-making, and craving in habitual gamblers

Porifera: Sudden Sperm Release by Tropical Demospongiae

From game engagement to craving responses - The role of gratification and compensation experiences during video-gaming in casual and at-risk gamers

Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

Reward Sensitivity and Waiting Impulsivity: Shift Towards Reward Valuation Away from Action Control.

Individuals with problem gambling and obsessive-compulsive disorder learn through distinct reinforcement mechanisms