Abstract:Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.

Previous experience with delays affects delay discounting in animal model of ADHD

Delay Discounting and Impulsive Choice in the Rat.

Immediate Reinforcement Training Has Moderate Effect on Delay Discounting Behavior in Rats: A Systematic Replication

Limbic Corticostriatal Systems and Delayed Reinforcement

Delay discounting in C57BL/6J and DBA/2J mice: Adolescent-limited and life-persistent patterns of impulsivity.

Delay aversion in school-aged children with attention-deficit hyperactivity disorder

Adaptive Aspects of Impulsivity and Interactions with Effects of Catecholaminergic Agents in the 5-Choice Serial Reaction Time Task: Implications for ADHD

Behavioural Characterisation of High Impulsivity on the 5-Choice Serial Reaction Time Task: Specific Deficits in ‘waiting’ Versus ‘Stopping’

Delay aversion and immediate choice in Sepedi-speaking primary school children with attention-deficit/hyperactivity disorder

The neural mechanisms of inter-temporal decision-making: understanding variability

Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays

Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex

Impulsivity, Risky Choice, And Impulse Control Disorders: Animal Models

Impulsive Choices Emerge When the Anterior Cingulate Cortex Fails to Encode Deliberative Strategies

‘Waiting Impulsivity’ in Isolation-Reared and Socially-Reared Rats: Effects of Amphetamine

The Effects of D -Amphetamine, Chlordiazepoxide, Α-Flupenthixol and Behavioural Manipulations on Choice of Signalled and Unsignalled Delayed Reinforcement in Rats

Neurobehavioral Mechanisms of Impulsivity: Fronto-striatal Systems and Functional Neurochemistry

Suboptimal decision making and interpersonal problems in ADHD: longitudinal evidence from a laboratory task

Genome-wide association study of delay discounting in Heterogeneous Stock rats

Evidence for post-decisional conflict monitoring in delay discounting

Effects of methamphetamine on delay discounting in rats using concurrent chains