Abstract:Recent success of artificial intelligence is largely based on reinforcement learning (RL), in which an agent acts to maximize expected rewards. RL has deep roots in Psychology for modeling animal behavior and captures the fact that human actions are driven by desires. Nevertheless, it misses one mental representation highlighted by more recent cognitive Theory-of-Mind (ToM) models: Intention. Unlike desires, intentions form stable, partial plans of action concerning the future, demand “commitment” (Bratman, 1987). While having conflicting desires is part of human nature (e.g. losing weight and enjoying food), intentions should always be coherent, stable and admissible. Here we tested predictions of RL and ToM in a visual navigation task involving conflicting desires. A human or RL model controls an agent to reach one of two equally desirable restaurants in a 2D map. With a low-probability, random action noises can cause the agent to drift slightly. To test “commitment to an intention”, we created a special trial: once the agent clearly moves towards one restaurant, noises will push the agent away so that the alternative restaurant becomes a better “rational” choice. As predicted, the RL agent showed no commitment, with close to 0% still pursuing the original restaurant. In contrast, in 70% of trials, humans fought the noise and pursued the original restaurant persistently. In addition, humans form a commitment with deliberation. In the same task, we performed online prediction of the agent’s destination through well-established Bayesian ToM. The results demonstrated that while RL quickly displayed a preference, humans avoided showing any preference early on. In conclusion, humans are unlike RL in that they appreciate the gravity of commitment, preferring not to rush forming an intention, but once committed, remain so despite setbacks. These results collectively demonstrate intention is an intrinsic mental representation that can forcefully regulate human actions through commitment.

The directive influence of attitudes on behavior.

Intention regulates conflicting desires in human decision making

Attitude-behavior relations: A theoretical analysis and review of empirical research.

The Interplay of Regulatory Fit and Construal Level in Influencing Behavioral Intention

The Moderator Effect of Attitude Stren gth on the Relationship Between Implicit Attitude and Explicit Attitude

A Comparison of the Theory of Planned Behavior and the Theory of Reasoned Action

Majority versus minority influence and prediction of behavioral intentions and behavior

Nature and Operation of Attitudes

Disentangling behavioral intention and behavioral expectation

Attitude theory and measurement in implementation science: a secondary review of empirical studies and opportunities for advancement

Behavior as a function of attitude-toward-object and attitude-toward-situation.

Values and Behavior: Strength and Structure of Relations

The theory of planned behaviour: reactions and reflections

A comparative analysis of two models of behavioral intention

Intention Beyond Desire: Humans Spontaneously Commit to Future Actions.

When questions change behavior: the role of ease of representation

Intention Beyond Desire: Commitment in Human Action

The generalization of deliberative and automatic behavior: The role of procedural knowledge and affective reactions

Attitude and behavior are correlates

Predicting and Changing Behavior: The Reasoned Action Approach

How Do Values Affect Behavior? Let Me Count the Ways