Abstract:A cornerstone of human intelligence is the ability to flexibly adjust our cognition and behavior as our goals change. For instance, achieving some goals requires efficiency, while others require caution. Adapting to these changing goals require corresponding adjustments in cognitive control (e.g., levels of attention, response thresholds). However, adjusting our control to meet new goals comes at a cost: we are better at achieving a goal in isolation than when transitioning between goals. The source of these remains poorly understood, and the bulk of our understanding of such costs comes from settings in which participants transition between discrete task sets, rather than performance goals. Across four experiments, we show that adjustments in continuous control states incur a performance cost, and that a dynamical systems model can explain the source of these costs. Participants performed a single cognitively demanding task under varying performance goals (e.g., to be fast or to be accurate). We modeled control allocation to include a dynamic process of adjusting from one’s current control state to a target state for a given performance goal. By incorporating inertia into this adjustment process, our model accounts for our empirical findings that people under-shoot their target control state more (i.e., exhibit larger adjustment costs) when (a) goals switch rather than remain fixed over a block (Study 1); (b) target control states are more distant from one another (Study 2); (c) less time is given to adjust to the new goal (Study 3); and (d) when anticipating having to switch goals more frequently (Study 4). Our findings characterize the costs of adjusting control to meet changing goals, and show that these costs can emerge directly from cognitive control dynamics. In so doing, they shed new light on the sources of and constraints on flexibility in human goal-directed behavior.

Control when confidence is costly

Lmi Approach To Optimal Guaranteed Cost Control For A Class Of Linear Uncertain Discrete Systems

Stochastic Optimal Control as Approximate Input Inference

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costs

Control adjustment costs limit goal flexibility: Empirical evidence and a computational account

Optimal Guaranteed Cost Control of an Uncertainty System and Its Application

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

Non-standard Stochastic Control with Nonlinear Feynman-Kac Costs

A Formal Approach to Modeling the Cost of Cognitive Control

Cognitive control as a multivariate optimization problem

Almost Optimal Agnostic Control of Unknown Linear Dynamics

Another Look at Partially Observed Optimal Stochastic Control: Existence, Ergodicity, and Approximations without Belief-Reduction

Closing the Gap to Quadratic Invariance: a Regret Minimization Approach to Optimal Distributed Control

Online Stackelberg Optimization via Nonlinear Control

Control Costs of Long-Range Interacting Multi-Agent Systems with Noise Perturbation

Online Markov decision processes with Kullback-Leibler control cost

Continuous-Time Dynamic Decision Making with Costly Information

Optimal control of spiking neural networks

A PAC-Bayesian Framework for Optimal Control with Stability Guarantees

Optimal control of stochastic reaction networks with entropic control cost and emergence of mode-switching strategies