Abstract:Objective We model the dynamic trust of human subjects in a human-autonomy-teaming screen-based task.
What problem does this paper attempt to address?
### The Problem the Paper Attempts to Solve
This paper aims to explore the modeling of trust dynamics when humans collaborate with autonomous agents. Specifically, the research goal is to analyze how autonomous agents with different capabilities and strategies influence human trust through a screen-based task.
### Background
Trust is an emerging research area in human-machine collaboration. Many studies primarily focus on machine performance as the sole predictor of human trust, but this approach may underestimate the complexity of interactions. This paper explores the impact of autonomous agents' capabilities and strategies on human trust through experimental design and attempts to establish time series models to capture these effects.
### Methods
In the experiment, participants were required to collaborate with different autonomous agents to search for anomalous objects on a screen. Each trial featured an autonomous agent with preset capabilities and one of three different search strategies. Participants needed to report their level of trust in the agent and evaluate the agent's behavior, reliability, and trustworthiness.
### Results
A total of 80 participants completed the experiment. Self-reported trust levels were modeled using Ordinary Least Squares (OLS), but in groups interacting with agents of different capabilities on a short time scale, the ARIMAX model performed better. Cross-validation between different groups showed moderate improvement in predicting trust for the next trial.
### Conclusion
Time series modeling methods revealed the impact of the temporal sequence of agent performance on trust estimation. Recent biases may affect the weight participants place on strategy or capability contributions to trust. Understanding the relationship between agent behavior, performance, and human trust is crucial for improving human-machine collaboration tasks.
### Applications
The modeling approach of this study suggests that to capture changes in human trust, it is necessary to represent the temporal changes in autonomous agent characteristics.
### Keywords
Autonomous agents, human-computer interaction, automated trust, decision-making, computer interface
### Experimental Design
The goal of the experimental task was to have participants interact with autonomous agents with different characteristics and report the agents' performance and their trust in the agents. The design of the experimental conditions considered the simultaneous variation of multiple factors. The experiment was conducted online via a web browser, allowing a large number of participants to be tested outside the laboratory.
### Trust Model
In previous work, we found the relationship between survey factors and trust through variance analysis. The goal of this study is to demonstrate the impact of autonomous agent behavior and performance on the temporal changes in human trust. The modeling process includes data preprocessing, Ordinary Least Squares regression, determining the order of the ARIMA model, fitting the ARIMAX model, and cross-validation.
### Results
Participants' trust scores varied in level and variance. Normalization allowed for better capture of individual trust score changes relative to the overall trend. Time series models (such as the ARIMA model) were used to capture changes in trust over time, and results showed that models including autoregressive components better captured information from previous trials. Cross-validation results indicated that linear regression models performed better on the training set, but in group cross-validation, the model for group 0 performed worse on group 1 data.
### Discussion
Participants' search behavior was influenced by the conditions of the autonomous agents. Participants collaborated with autonomous agents to search grid areas within 20 seconds, exhibiting different behavior patterns. Participants in different groups learned the paths of autonomous agents on different time scales, which may have influenced their search behavior. The effect of parameter order captured these differences, and future work will further analyze participants' search behavior.