Abstract:Large Language Models have shown exceptional generative abilities in various natural language and generation tasks. However, possible anthropomorphization and leniency towards failure cases have propelled discussions on emergent abilities of Large Language Models especially on Theory of Mind (ToM) abilities in Large Language Models. While several false-belief tests exists to verify the ability to infer and maintain mental models of another entity, we study a special application of ToM abilities that has higher stakes and possibly irreversible consequences : Human Robot Interaction. In this work, we explore the task of Perceived Behavior Recognition, where a robot employs a Large Language Model (LLM) to assess the robot's generated behavior in a manner similar to human observer. We focus on four behavior types, namely - explicable, legible, predictable, and obfuscatory behavior which have been extensively used to synthesize interpretable robot behaviors. The LLMs goal is, therefore to be a human proxy to the agent, and to answer how a certain agent behavior would be perceived by the human in the loop, for example "Given a robot's behavior X, would the human observer find it explicable?". We conduct a human subject study to verify that the users are able to correctly answer such a question in the curated situations (robot setting and plan) across five domains. A first analysis of the belief test yields extremely positive results inflating ones expectations of LLMs possessing ToM abilities. We then propose and perform a suite of perturbation tests which breaks this illusion, i.e. Inconsistent Belief, Uninformative Context and Conviction Test. We conclude that, the high score of LLMs on vanilla prompts showcases its potential use in HRI settings, however to possess ToM demands invariance to trivial or irrelevant perturbations in the context which LLMs lack.

Represent and Infer Human Theory of Mind for Human-Robot Interaction.

Inferring Human Intent from Video by Sampling Hierarchical Plans

Inferring Belief States in Partially-Observable Human-Robot Teams

Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs

Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?

A Brain-Inspired Model of Theory of Mind

AI Challenges in Human-Robot Cognitive Teaming

Probabilistic Modeling of Human Movements for Intention Inference.

A Vision-Based Measure of Environmental Effects on Inferring Human Intention During Human Robot Interaction

Enhancing Human-AI Collaboration Through Logic-Guided Reasoning

BOSS: A Benchmark for Human Belief Prediction in Object-context Scenarios

Learning Triadic Belief Dynamics in Nonverbal Communication from Videos

MIRA: Mental Imagery for Robotic Affordances

The Design of Human-Robot Spatial Cognition Interaction System

Human–robot interaction-oriented video understanding of human actions

It Takes Two to Tango: Towards Theory of AI's Mind

Knowledge-based multimodal information fusion for role recognition and situation assessment by using mobile robot

Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks

Bayesian Intention for Enhanced Human Robot Collaboration

Modeling human intention inference in continuous 3D domains by inverse planning and body kinematics

Enhancing Interpretability and Interactivity in Robot Manipulation: A Neurosymbolic Approach