Abstract:Large Language Models have shown exceptional generative abilities in various natural language and generation tasks. However, possible anthropomorphization and leniency towards failure cases have propelled discussions on emergent abilities of Large Language Models especially on Theory of Mind (ToM) abilities in Large Language Models. While several false-belief tests exists to verify the ability to infer and maintain mental models of another entity, we study a special application of ToM abilities that has higher stakes and possibly irreversible consequences : Human Robot Interaction. In this work, we explore the task of Perceived Behavior Recognition, where a robot employs a Large Language Model (LLM) to assess the robot's generated behavior in a manner similar to human observer. We focus on four behavior types, namely - explicable, legible, predictable, and obfuscatory behavior which have been extensively used to synthesize interpretable robot behaviors. The LLMs goal is, therefore to be a human proxy to the agent, and to answer how a certain agent behavior would be perceived by the human in the loop, for example "Given a robot's behavior X, would the human observer find it explicable?". We conduct a human subject study to verify that the users are able to correctly answer such a question in the curated situations (robot setting and plan) across five domains. A first analysis of the belief test yields extremely positive results inflating ones expectations of LLMs possessing ToM abilities. We then propose and perform a suite of perturbation tests which breaks this illusion, i.e. Inconsistent Belief, Uninformative Context and Conviction Test. We conclude that, the high score of LLMs on vanilla prompts showcases its potential use in HRI settings, however to possess ToM demands invariance to trivial or irrelevant perturbations in the context which LLMs lack.

Mathematical Models of Theory of Mind

A Brain-Inspired Model of Theory of Mind

Experiments in Artificial Theory of Mind: From Safety to Story-Telling

Cognitive Models for Machine Theory of Mind

A Conceptual Framework of Cognitive-Affective Theory of Mind: Towards a Precision Identification of Mental Disorders

Towards a computational model for higher orders of Theory of Mind in social agents

Reading the Mind in Robots: How Theory of Mind Ability Alters Mental State Attributions During Human-Robot Interactions

Enhancing Robot Assistive Behaviour with Reinforcement Learning and Theory of Mind

Transferring Adaptive Theory of Mind to social robots: insights from developmental psychology to robotics

Supporting Artificial Social Intelligence With Theory of Mind

Cognitive Architecture for Mutual Modelling

Theory of Mind From Observation in Cognitive Models and Humans

Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

Modeling Theory of Mind in Multi-Agent Games Using Adaptive Feedback Control

Theory of Mind Based Assistive Communication in Complex Human Robot Cooperation

Utility-based Adaptive Teaching Strategies using Bayesian Theory of Mind

Satisficing Mentalizing: Bayesian Models of Theory of Mind Reasoning in Scenarios with Different Uncertainties

MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks

Developing Computational Models of Social Assistance to Guide Socially Assistive Robots

Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?

Theory of Mind and Preference Learning at the Interface of Cognitive Science, Neuroscience, and AI: A Review