Abstract:Collaborative virtual agents help human operators to perform tasks in real-time. For this collaboration to be effective, human operators must appropriately trust the agent(s) they are interacting with. Multiple factors influence trust, such as the context of interaction, prior experiences with automated systems and the quality of the help offered by agents in terms of its transparency and performance. Most of the literature on trust in automation identified the performance of the agent as a key factor influencing trust. However, other work has shown that the behavior of the agent, type of the agent's errors, and predictability of the agent's actions can influence the likelihood of the user's reliance on the agent and efficiency of tasks completion. Our work focuses on how agents' predictability affects cognitive load, performance and users' trust in a real-time human-agent collaborative task. We used an interactive aiming task where participants had to collaborate with different agents that varied in terms of their predictability and performance. This setup uses behavioral information (such as task performance and reliance on the agent) as well as standardized survey instruments to estimate participants' reported trust in the agent, cognitive load and perception of task difficulty. Thirty participants took part in our lab-based study. Our results showed that agents with more predictable behaviors have a more positive impact on task performance, reliance and trust while reducing cognitive workload. In addition, we investigated the human-agent trust relationship by creating models that could predict participants' trust ratings using interaction data. We found that we could reliably estimate participants' reported trust in the agents using information related to performance, task difficulty and reliance. This study provides insights on behavioral factors that are the most meaningful to anticipate complacent or distrusting attitudes toward automation. With this work, we seek to pave the way for the development of trust-aware agents capable of responding more appropriately to users by being able to monitor components of the human-agent relationships that are the most salient for trust calibration.

Assessing Human Interaction in Virtual Reality With Continually Learning Prediction Agents Based on Reinforcement Learning Algorithms: A Pilot Study

Learned human-agent decision-making, communication and joint action in a virtual reality environment

Can interaction with generative artificial intelligence enhance learning autonomy? A longitudinal study from comparative perspectives of virtual companionship and knowledge acquisition preferences

Towards personalized human AI interaction - adapting the behavior of AI agents using neural signatures of subjective interest

Human-AI Collaboration in Real-World Complex Environment with Reinforcement Learning

The promise and peril of interactive embodied agents for studying non-verbal communication: a machine learning perspective

Learning on the Job: Long-Term Behavioural Adaptation in Human-Robot Interactions

Reinforcement Learning for Sparse-Reward Object-Interaction Tasks in a First-person Simulated 3D Environment

Reinforcement Learning based Embodied Agents Modelling Human Users Through Interaction and Multi-Sensory Perception

Inferring Trust From Users' Behaviours; Agents' Predictability Positively Affects Trust, Task Performance and Cognitive Load in Human-Agent Real-Time Collaboration

Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape

ImCasting: Nonverbal Behaviour Reinforcement Learning of Virtual Humans through Adaptive Immersive Game

Complex Interaction as Emergent Behaviour: Simulating Mid-Air Virtual Keyboard Typing using Reinforcement Learning

A Digital Twin Framework for Reinforcement Learning with Real-Time Self-Improvement via Human Assistive Teleoperation

Learning Complex Spatial Behaviours in ABM: An Experimental Observational Study

Real-World Human-Robot Collaborative Reinforcement Learning

Metaversal Learning Environments: Measuring, predicting and improving interpersonal effectiveness

Human-Level Reinforcement Learning through Theory-Based Modeling, Exploration, and Planning

How do people incorporate advice from artificial agents when making physical judgments?

Safe Deep RL in 3D Environments using Human Feedback

Predicting and Understanding Turn-Taking Behavior in Open-Ended Group Activities in Virtual Reality