Abstract:It is an ancient insight that human actions are driven by desires. This insight inspired the formulation that a rational agent acts to maximize expected utility (MEU), which has been widely used in psychology for modeling theory of mind and in artificial intelligence (AI) for controlling machines’ actions. Yet, it's rather unclear how humans act coherently when their desires are complex and often conflicting with each other. Here we show desires do not directly control human actions. Instead, actions are regulated by an intention — a deliberate mental state that commits to a fixed future rather than taking the expected utilities of many futures evaluated by many desires. Our study reveals four behavioral signatures of human intention by demonstrating how human sequential decision-making deviates from the optimal policy based on MEU in a navigation task: “Disruption resistance” as the persistent pursuit of an original intention despite an unexpected change has made that intention suboptimal; “Ulysses-constraint of freedom” as the proactive constraint of one’s freedom by avoiding a path that could lead to many futures, similar to Ulysses’s self-binding to resist the temptation of the Siren’s song; “Enhanced legibility” as an active demonstration of intention by choosing a path whose destination can be promptly inferred by a third-party observer; “Temporal leap” as committing to a distant future even before reaching the proximal one. Our results showed how the philosophy of intention can lead to discoveries of human decision-making, which can also be empirically compared with AI algorithms. The findings showing that to define a theory of mind, intention should be highlighted as a distinctive mental state in between desires and actions, for quarantining conflicting desires from the execution of actions.

The Incentives that Shape Behaviour

Intention regulates conflicting desires in human decision making

The Effects of Incentives on Choices and Beliefs in Games: An Experiment

Causal inference on human behaviour

Characterising Decision Theories with Mechanised Causal Graphs

Subjective Causality

Modeling AGI Safety Frameworks with Causal Influence Diagrams

The Effect of Incentive Structure on Referral: the Determining Role of Self-Construal

Incentive Engineering for Concurrent Games

Characterising Interventions in Causal Games

Conditional independences and causal relations implied by sets of equations

The Reasons that Agents Act: Intention and Instrumental Goals

Explainable Reinforcement Learning Through a Causal Lens

Causal Inference Grounded in Causal Diagrams: Benefits, Limitations, and Opportunities for the Information Systems Field

The effect of incentives on intertemporal choice: Choice, confidence, and eye movements

Causal Campbell-Goodhart's law and Reinforcement Learning

Disentangled Representations for Causal Cognition

Emergent Causality and the Foundation of Consciousness

Incentive Design with Spillovers

Neural and Computational Mechanisms of Motivation and Decision-making

Modeling and Discovering Direct Causes for Predictive Models