Abstract:Recent success of artificial intelligence is largely based on reinforcement learning (RL), in which an agent acts to maximize expected rewards. RL has deep roots in Psychology for modeling animal behavior and captures the fact that human actions are driven by desires. Nevertheless, it misses one mental representation highlighted by more recent cognitive Theory-of-Mind (ToM) models: Intention. Unlike desires, intentions form stable, partial plans of action concerning the future, demand “commitment” (Bratman, 1987). While having conflicting desires is part of human nature (e.g. losing weight and enjoying food), intentions should always be coherent, stable and admissible. Here we tested predictions of RL and ToM in a visual navigation task involving conflicting desires. A human or RL model controls an agent to reach one of two equally desirable restaurants in a 2D map. With a low-probability, random action noises can cause the agent to drift slightly. To test “commitment to an intention”, we created a special trial: once the agent clearly moves towards one restaurant, noises will push the agent away so that the alternative restaurant becomes a better “rational” choice. As predicted, the RL agent showed no commitment, with close to 0% still pursuing the original restaurant. In contrast, in 70% of trials, humans fought the noise and pursued the original restaurant persistently. In addition, humans form a commitment with deliberation. In the same task, we performed online prediction of the agent’s destination through well-established Bayesian ToM. The results demonstrated that while RL quickly displayed a preference, humans avoided showing any preference early on. In conclusion, humans are unlike RL in that they appreciate the gravity of commitment, preferring not to rush forming an intention, but once committed, remain so despite setbacks. These results collectively demonstrate intention is an intrinsic mental representation that can forcefully regulate human actions through commitment.

Intention Beyond Desire: Humans Spontaneously Commit to Future Actions.

Intention regulates conflicting desires in human decision making

Intention Beyond Desire: Spontaneous Intentional Commitment Regulates Conflicting Desires.

Intention Beyond Desire: Commitment in Human Action

Intentional commitment as a spontaneous presentation of self

Intention as Hierarchical Constraints in Human Planning

The Development of Commitment: Attention for Intention.

Conscious Intention-Based Processes Impact the Neural Activities Prior to Voluntary Action on Reinforcement Learning Schedules

Habits and Goals in Synergy: a Variational Bayesian Framework for Behavior

Towards a Theory of Intentions for Human-Robot Collaboration

CogIntAc: Modeling the Relationships between Intention, Emotion and Action in Interactive Process from Cognitive Perspective

An Intention Model for Agent

Adaptive control of human action: the role of outcome representations and reward signals

Planning and representing intentional action

Neural substrates of intention--consequence integration and its impact on reactive punishment in interpersonal transgression

Neural signatures of voluntary action with long-range intentions

Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior.

Can the Brain Strategically Go on Automatic Pilot? The Effect of If-Then Planning on Behavioral Flexibility

The Reasons that Agents Act: Intention and Instrumental Goals

The effect of intentionality on reactive aggression：a rs-fMRI study on individual differences

Interactive POMDP Lite: Towards Practical Planning to Predict and Exploit Intentions for Interacting with Self-Interested Agents