Abstract:Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.

Increased Behavioral Sensitivity to Repeated Experiences of Punishment in Children With ADHD: Experimental Studies Using the Matching Law

Behavioral and Emotional Responding to Punishment in ADHD: Is Increased Emotionality Related to Altered Behavioral Responding?

Behavioral sensitivity of Japanese children with and without ADHD to changing reinforcer availability: an experimental study using signal detection methodology

Children’s Reward and Punishment Sensitivity Moderates the Association of Negative and Positive Parenting Behaviors in Child ADHD Symptoms

Anger and Selective Attention to Reward and Punishment in Children

Examining the Association between Punishment and Reward Sensitivity and Response Inhibition to Previously-Incentivized Cues across Development

Reward and Punishment Sensitivity are Associated with Cross-disorder Traits

Punishment Promotes Response Control Deficits in Obsessive-Compulsive Disorder: Evidence from a Motivational Go/no-Go Task.

Inhibitory Control and Harsh Discipline As Predictors of Externalizing Problems in Young Children: A Comparative Study of U.S., Chinese, and Japanese Preschoolers

Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex

Preference for Smaller Sooner over Larger Later Rewards in ADHD: Contribution of Delay Duration and Paradigm Type

Reward-Related Dysfunctions in Children Developing Attention Deficit Hyperactivity Disorder—Roles of Oppositional and Callous-Unemotional Symptoms

Relationships between experimental task and questionnaire measures of reward/punishment sensitivity in attention-deficit/hyperactivity disorder (ADHD): protocol for a scoping review

A Transdiagnostic Dimensional Approach to Behavioral Dysregulation: Examining Reward and Punishment Sensitivity Across Psychopathology

Preferential Choice to Exert Cognitive Effort in Children with ADHD: a Diffusion Modelling Account

Reduced Error Recognition Explains Post-Error Slowing Differences among Children with Attention Deficit Hyperactivity Disorder

Reward-Related Dysfunctions in Children Developing Attention Deficit Hyperactivity Disorder-Roles of Oppositional and Callous-Unemotional Symptoms

Punishing temporal judgement boosts sense of agency and modulates its underlying neural correlates

Reward processing in children with Affective Dysregulation

The association between punishment and cooperation in children with high-functioning autism

Sensitivity to reward and punishment in adolescents with repetitive non-suicidal self-injury: The role of inhibitory control