Abstract:Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.

Electrical brain activations in preadolescents during a probabilistic reward-learning task reflect cognitive processes and behavioral strategy.

Divergent reward cue representations in prefrontal cortex underlie differences in reward motivation between adolescents and adults

Adolescent-specific Patterns of Behavior and Neural Activity During Social Reinforcement Learning

A brief child-friendly reward task reliably activates the ventral striatum in two samples of socioeconomically diverse youth

Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex

Developmental differences in striatal recruitment by reward prospects as a function of attentional demand

Brain Activity Elicited by Positive and Negative Feedback in Preschool-Aged Children

Differential processing of risk and reward in delinquent and non-delinquent youth

Reward processing in children with Affective Dysregulation

Feedback Processing in Adolescence: An Event-Related Potential Study of Age and Gender Differences

How Instructed Knowledge Modulates the Neural Systems of Reward Learning

The Influence of Reward Anticipation on Conflict Control in Children and Adolescents: Evidences from Hierarchical Drift-Diffusion Model and Event-Related Potentials

The impact of successful learning of self-regulation on reward processing in children with ADHD using fMRI

Reward-Related Brain Activity Mediates the relationship between Decision-Making Deficits and Pediatric Depression Symptom Severity

Neural Dynamics of Reward-Induced Response Activation and Inhibition.

Developmental effects of reward on sustained attention networks

Learning in anticipation of reward and punishment: Perspectives across the human lifespan

Changes in Behavior and Neural Dynamics across Adolescent Development

Prefrontal Excitation/ Inhibition Balance Supports Adolescent Enhancements in Circuit Signal to Noise Ratio

Structure-function coupling within the reward network in preschool children predicts executive functioning in later childhood

Reactivation of reward representations associated with the reinforcement of behavior