Abstract:A cornerstone of human intelligence is the ability to flexibly adjust our cognition and behavior as our goals change. For instance, achieving some goals requires efficiency, while others require caution. Adapting to these changing goals require corresponding adjustments in cognitive control (e.g., levels of attention, response thresholds). However, adjusting our control to meet new goals comes at a cost: we are better at achieving a goal in isolation than when transitioning between goals. The source of these remains poorly understood, and the bulk of our understanding of such costs comes from settings in which participants transition between discrete task sets, rather than performance goals. Across four experiments, we show that adjustments in continuous control states incur a performance cost, and that a dynamical systems model can explain the source of these costs. Participants performed a single cognitively demanding task under varying performance goals (e.g., to be fast or to be accurate). We modeled control allocation to include a dynamic process of adjusting from one’s current control state to a target state for a given performance goal. By incorporating inertia into this adjustment process, our model accounts for our empirical findings that people under-shoot their target control state more (i.e., exhibit larger adjustment costs) when (a) goals switch rather than remain fixed over a block (Study 1); (b) target control states are more distant from one another (Study 2); (c) less time is given to adjust to the new goal (Study 3); and (d) when anticipating having to switch goals more frequently (Study 4). Our findings characterize the costs of adjusting control to meet changing goals, and show that these costs can emerge directly from cognitive control dynamics. In so doing, they shed new light on the sources of and constraints on flexibility in human goal-directed behavior.

In praise of folly: flexible goals and human cognition

Goals as Reward-Producing Programs

Intention Beyond Desire: Humans Spontaneously Commit to Future Actions.

Intention as Hierarchical Constraints in Human Planning

Creativity, Compositionality, and Common Sense in Human Goal Generation

Control adjustment costs limit goal flexibility: Empirical evidence and a computational account

People's thinking plans adapt to the problem they're trying to solve

The Gilding-the-Lily Effect: Exploratory Behavior Energized by Curiosity

Cognitive prostheses for goal achievement

Computational mechanisms of curiosity and goal-directed exploration

Expanding horizons in reinforcement learning for curious exploration and creative planning

Embracing curiosity eliminates the exploration-exploitation dilemma

Infinite Ends from Finite Samples: Open-Ended Goal Inference as Top-Down Bayesian Filtering of Bottom-Up Proposals

Précis of Simple heuristics that make us smart

Goal weighting and the choice of behaviour in a complex world

Changes in cognitive flexibility and hypothesis search across human life history from childhood to adolescence to adulthood

Dynamic Neural Curiosity Enhances Learning Flexibility for Autonomous Goal Discovery

The Paradox of Reason:Deifying Instrument as Goal

Toward a normative theory of (self-)management by goal-setting

The Efficiency of Human Cognition Reflects Planned Information Processing

Curiosity and the dynamics of optimal exploration