Abstract:Recent success of artificial intelligence is largely based on reinforcement learning (RL), in which an agent acts to maximize expected rewards. RL has deep roots in Psychology for modeling animal behavior and captures the fact that human actions are driven by desires. Nevertheless, it misses one mental representation highlighted by more recent cognitive Theory-of-Mind (ToM) models: Intention. Unlike desires, intentions form stable, partial plans of action concerning the future, demand “commitment” (Bratman, 1987). While having conflicting desires is part of human nature (e.g. losing weight and enjoying food), intentions should always be coherent, stable and admissible. Here we tested predictions of RL and ToM in a visual navigation task involving conflicting desires. A human or RL model controls an agent to reach one of two equally desirable restaurants in a 2D map. With a low-probability, random action noises can cause the agent to drift slightly. To test “commitment to an intention”, we created a special trial: once the agent clearly moves towards one restaurant, noises will push the agent away so that the alternative restaurant becomes a better “rational” choice. As predicted, the RL agent showed no commitment, with close to 0% still pursuing the original restaurant. In contrast, in 70% of trials, humans fought the noise and pursued the original restaurant persistently. In addition, humans form a commitment with deliberation. In the same task, we performed online prediction of the agent’s destination through well-established Bayesian ToM. The results demonstrated that while RL quickly displayed a preference, humans avoided showing any preference early on. In conclusion, humans are unlike RL in that they appreciate the gravity of commitment, preferring not to rush forming an intention, but once committed, remain so despite setbacks. These results collectively demonstrate intention is an intrinsic mental representation that can forcefully regulate human actions through commitment.

Human Goal Recognition as Bayesian Inference: Investigating the Impact of Actions, Timing, and Goal Solvability

Evaluation of Goal Recognition Systems on Unreliable Data and Uninspectable Agents

Data-Driven Goal Recognition Design for General Behavioral Agents

Goal Recognition as Reinforcement Learning

Goal recognition via model-based and model-free techniques

Goal Inference Improves Objective and Perceived Performance in Human-Robot Collaboration

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Activity, Plan, and Goal Recognition: A Review

Infinite Ends from Finite Samples: Open-Ended Goal Inference as Top-Down Bayesian Filtering of Bottom-Up Proposals

Intention Beyond Desire: Commitment in Human Action

Human Action Recognition Using Deep Learning Methods.

Investigating the Combination of Planning-Based and Data-Driven Methods for Goal Recognition

Heuristic Online Goal Recognition in Continuous Domains

A Survey on Goal Recognition as Planning

Robust Neuro-Symbolic Goal and Plan Recognition

Goal Recognition over Imperfect Domain Models

Goal Recognition via Linear Programming

Goal Alignment: Re-analyzing Value Alignment Problems Using Human-Aware AI

Cost-Based Goal Recognition Meets Deep Learning

Context-aware Human Intent Inference for Improving Human Machine Cooperation

Landmark-Based Heuristics for Goal Recognition