Abstract:Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.

Preferential Choice to Exert Cognitive Effort in Children with ADHD: a Diffusion Modelling Account

A diffusion model analysis of sustained attention in children with attention deficit hyperactivity disorder.

Neural dysfunction during temporal discounting in paediatric Attention-Deficit/Hyperactivity Disorder and Obsessive-Compulsive Disorder

Neurophysiology of perceptual decision-making and its alterations in attention-deficit hyperactivity disorder (ADHD)

Impairments in resource allocation and executive control in children with ADHD

Preference for Smaller Sooner over Larger Later Rewards in ADHD: Contribution of Delay Duration and Paradigm Type

Behavioral sensitivity of Japanese children with and without ADHD to changing reinforcer availability: an experimental study using signal detection methodology

Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex

Working memory and inhibitory control deficits in children with ADHD: an experimental evaluation of competing model predictions

The Clinical Manifestation, Executive Dysfunction, and Caregiver Strain in Subthreshold Attention-Deficit/Hyperactivity Disorder.

Attentional Selection and Suppression in Children With Attention-Deficit/Hyperactivity Disorder.

Unraveling the Optimum Latent Structure of Attention-Deficit/Hyperactivity Disorder: Evidence Supporting ICD and HiTOP Frameworks

The experience of effort in ADHD: a scoping review

Functional Near-Infrared Spectroscopy Evidence of Prefrontal Regulation of Cognitive Flexibility in Adults With ADHD

Emotion-Cognition Interactions in Attention-Deficit/Hyperactivity Disorder: Increased Early Attention Capture and Weakened Attentional Control in Emotional Contexts

Attentional Selection and Suppression in Children with Attention-Deficit/Hyperactivity Disorder

A trial-by-trial analysis reveals more intense physical activity is associated with better cognitive control performance in attention-deficit/hyperactivity disorder

Delay aversion and immediate choice in Sepedi-speaking primary school children with attention-deficit/hyperactivity disorder

Cognitive Control Deficits in Children With Subthreshold Attention-Deficit/Hyperactivity Disorder

Validation of a novel effort‐discounting assessment and evaluation of the effort‐delay confound on effort discounting

Is hyperactivity in children with attention deficit/hyperactivity disorder (ADHD) a functional response to demands on specific executive functions or cognitive demands in general?