Abstract:Effective human-robot teaming (HRT) increasingly requires humans to work with intelligent, autonomous machines. However, novel features of intelligent autonomous systems such as social agency and incomprehensibility may influence the human's trust in the machine. The human operator's mental model for machine functioning is critical for trust. People may consider an intelligent machine partner as either an advanced tool or as a human-like teammate. This article reports a study that explored the role of individual differences in the mental model in a simulated environment. Multiple dispositional factors that may influence the dominant mental model were assessed. These included the Robot Threat Assessment (RoTA), which measures the person's propensity to apply tool and teammate models in security contexts. Participants (N = 118) were paired with an intelligent robot tasked with making threat assessments in an urban setting. A transparency manipulation was used to influence the dominant mental model. For half of the participants, threat assessment was described as physics-based (e.g., weapons sensed by sensors); the remainder received transparency information that described psychological cues (e.g., facial expression). We expected that the physics-based transparency messages would guide the participant toward treating the robot as an advanced machine (advanced tool mental model activation), while psychological messaging would encourage perceptions of the robot as acting like a human partner (teammate mental model). We also manipulated situational danger cues present in the simulated environment. Participants rated their trust in the robot's decision as well as threat and anxiety, for each of 24 urban scenes. They also completed the RoTA and additional individual-difference measures. Findings showed that trust assessments reflected the degree of congruence between the robot's decision and situational danger cues, consistent with participants acting as Bayesian decision makers. Several scales, including the RoTA, were more predictive of trust when the robot was making psychology-based decisions, implying that trust reflected individual differences in the mental model of the robot as a teammate. These findings suggest scope for designing training that uncovers and mitigates the individual's biases toward intelligent machines.

Does One Bad Machine Spoil the Bunch?: A Review of Trust in Multiple-Component Systems

Enhancing component-specific trust with consumer automated systems through humanness design

A review of mathematical models of human trust in automation

A New Look at the Dynamics of Human-Automation Trust: Is Trust in Humans Comparable to Trust in Machines?

Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation

Trusting Automation: Designing for Responsivity and Resilience

Does automation trust evolve from a leap of faith? An analysis using a reprogrammed pasteurizer simulation task

Computational Modeling of the Dynamics of Human Trust During Human–Machine Interactions

Active and Passive User Trust in Sociotechnical Systems

An Empirical Model of Cultural Factors on Trust in Automation

Trust, control strategies and allocation of function in human-machine systems

Trust in the Danger Zone: Individual Differences in Confidence in Robot Threat Assessments

Trust with Autonomous Intelligence Systems to Promote Adoption in Assistive Technologies: A Literature Review

A Meta-Analysis of Factors Influencing the Development of Trust in Automation

IMPACTS Homeostasis Trust Management System: Optimizing Trust in Human-AI Teams

Converging Measures and an Emergent Model: A Meta-Analysis of Human-Automation Trust Questionnaires

The Effect of Trust and its Antecedents on Robot Acceptance

Revisiting human-machine trust: a replication study of Muir and Moray (1996) using a simulated pasteurizer plant task

How different types of users develop trust in technology: a qualitative analysis of the antecedents of active and passive user trust in a shared technology.

A review of experimental research on organizational trust

Effects of Faults, Experience, and Personality on Trust in a Robot Co-Worker