Abstract:Healthy adults flexibly adapt their learning strategies to ongoing changes in uncertainty, a key feature of adaptive behaviour. However, the developmental trajectory of this ability is yet unknown, as developmental studies have not incorporated trial-to-trial variation in uncertainty in their analyses or models. To address this issue, we compared adolescents' and adults' trial-to-trial dynamics of uncertainty, learning rate, and exploration in two tasks that assess learning in noisy but otherwise stable environments. In an estimation task—which provides direct indices of trial-specific learning rate—both age groups reduced their learning rate over time, as self-reported uncertainty decreased. Accordingly, the estimation data in both groups was better explained by a Bayesian model with dynamic learning rate (Kalman filter) than by conventional reinforcement-learning models. Furthermore, adolescents' learning rates asymptoted at a higher level, reflecting an over-weighting of the most recent outcome, and the estimated Kalman-filter parameters suggested that this was due to an overestimation of environmental volatility. In a choice task, both age groups became more likely to choose the higher-valued option over time, but this increase in choice accuracy was smaller in the adolescents. In contrast to the estimation task, we found no evidence for a Bayesian expectation-updating process in the choice task, suggesting that estimation and choice tasks engage different learning processes. However, our modeling results of the choice task suggested that both age groups reduced their degree of exploration over time, and that the adolescents explored overall more than the adults. Finally, age-related differences in exploration parameters from fits to the choice data were mediated by participants' volatility parameter from fits to the estimation data. Together, these results suggest that adolescents overestimate the rate of environmental change, resulting in elevated learning rates and increased exploration, which may help understand developmental changes in learning and decision-making.To successfully learn the value of stimuli and actions, people should take into account their current (un)certainty about these values: Learning rates and exploration should be high when one's value estimates are highly uncertain (in the beginning of learning), and decrease over time as evidence accumulates and uncertainty decreases. Recent studies have shown that healthy adults flexibly adapt their learning strategies based on ongoing changes in uncertainty, consistent with normative learning. However, the development of this ability prior to adulthood is yet unknown, as developmental learning studies have not considered trial-to-trial changes in uncertainty. Here, we show that adolescents, as compared to adults, showed a smaller decrease in both learning rate and exploration over time. Computational modeling revealed that both of these effects were due to adolescents overestimating the amount of environmental volatility, which made them more sensitive to recent relative to older evidence. The overestimation of volatility during adolescence may represent the rapidly changing environmental demands during this developmental period, and can help understand the surge in real-life risk taking and exploratory behaviours characteristic of adolescents.

Are Mid-Adolescents Prone to Risky Decisions? The Influence of Task Setting and Individual Differences in Temperament

Age Patterns in Risk Taking Across the World

Risk Taking During Decision-Making in Normal Volunteers Changes with Age

Adolescent Decision-Making Under Risk: Neural Correlates and Sex Differences.

Adolescent risk-taking is predicted by individual differences in cognitive control over emotional, but not non-emotional, response conflict

Development of the triadic neural systems involved in risky decision-making during childhood

Who are those “risk-taking adolescents”? Individual differences in developmental neuroimaging research

Is adolescence a time of heightened risk taking? An overview of types of risk-taking behaviors across age groups

Age differences in sensation seeking and impulsivity as indexed by behavior and self-report: Evidence for a dual systems model.

Decision Making in Children and Adolescents: Impaired Iowa Gambling Task Performance in Early Adolescence.

Adolescents' Perceptions of Social Risk and Prosocial Tendencies: Developmental Change and Individual Differences

Uncertainty-driven regulation of learning and exploration in adolescents: A computational account

A Longitudinal Analysis of Adolescent Decision-Making With the Iowa Gambling Task

Multiple timescales of temporal context in risky choice: Behavioral identification and relationships to physiological arousal

Reward processing and intertemporal decision making in adults and adolescents: The role of impulsivity and decision consistency

Altered interaction of physiological activity and behavior affects risky decision-making in ADHD

Model-based network discovery of developmental and performance-related differences during risky decision-making

Optimistic Risk Perception in the Temporal Difference error Explains the Relation between Risk-taking, Gambling, Sensation-seeking and Low Fear

Combined Effects of Social Exclusion and Social Rank Feedback on Risky Decision-Making Across Adolescence

Life in the fast lane: the role of temporal processing in risk-taking behaviors

Examining Impulsivity and Risky Decision Making among School Youth in Balloon Analogue Risk Task