Abstract:Collaborative virtual agents help human operators to perform tasks in real-time. For this collaboration to be effective, human operators must appropriately trust the agent(s) they are interacting with. Multiple factors influence trust, such as the context of interaction, prior experiences with automated systems and the quality of the help offered by agents in terms of its transparency and performance. Most of the literature on trust in automation identified the performance of the agent as a key factor influencing trust. However, other work has shown that the behavior of the agent, type of the agent's errors, and predictability of the agent's actions can influence the likelihood of the user's reliance on the agent and efficiency of tasks completion. Our work focuses on how agents' predictability affects cognitive load, performance and users' trust in a real-time human-agent collaborative task. We used an interactive aiming task where participants had to collaborate with different agents that varied in terms of their predictability and performance. This setup uses behavioral information (such as task performance and reliance on the agent) as well as standardized survey instruments to estimate participants' reported trust in the agent, cognitive load and perception of task difficulty. Thirty participants took part in our lab-based study. Our results showed that agents with more predictable behaviors have a more positive impact on task performance, reliance and trust while reducing cognitive workload. In addition, we investigated the human-agent trust relationship by creating models that could predict participants' trust ratings using interaction data. We found that we could reliably estimate participants' reported trust in the agents using information related to performance, task difficulty and reliance. This study provides insights on behavioral factors that are the most meaningful to anticipate complacent or distrusting attitudes toward automation. With this work, we seek to pave the way for the development of trust-aware agents capable of responding more appropriately to users by being able to monitor components of the human-agent relationships that are the most salient for trust calibration.

Predicting Trust Dynamics with Dynamic SEM in Human-AI Cooperation

Modeling and Predicting Trust Dynamics in Human-Robot Teaming: A Bayesian Inference Approach

Predicting with confidence – an improved dynamic cell structure

Trust-Aware Decision Making for Human-Robot Collaboration: Model Learning and Planning

A Unified Bi-directional Model for Natural and Artificial Trust in Human-Robot Collaboration

Dynamics of Trust in Automation and Interactive Decision Making During Driving Simulation Tasks

Dynamic Human Trust Modeling of Autonomous Agents With Varying Capability and Strategy

Computational Modeling of the Dynamics of Human Trust During Human–Machine Interactions

Dynamic and quantitative trust modeling and real-time estimation in human-machine co-driving process

Predicting Trust Using Automated Assessment of Multivariate Interactional Synchrony

Trust-Aware Assistance Seeking in Human-Supervised Autonomy

Real-Time Estimation of Drivers’ Trust in Automated Driving Systems

Inferring Trust From Users' Behaviours; Agents' Predictability Positively Affects Trust, Task Performance and Cognitive Load in Human-Agent Real-Time Collaboration

Assessing Trust in Construction AI-Powered Collaborative Robots Using Structural Equation Modeling

Building Trust Profiles in Conditionally Automated Driving

Trust-Preserved Human-Robot Shared Autonomy enabled by Bayesian Relational Event Modeling

Empirical Evaluations of Framework for Adaptive Trust Calibration in Human-AI Cooperation

A Case Study of Trust on Autonomous Driving

Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learning

Clustering Human Trust Dynamics for Customized Real-time Prediction

Modeling Human Trust and Reliance in AI-Assisted Decision Making: A Markovian Approach