To Err is Automation: Can Trust be Repaired by the Automated Driving System After its Failure?
Peng Liu,Yueying Chu,Guanqun Wang,Zhigang Xu
DOI: https://doi.org/10.1109/thms.2024.3434680
2024-09-21
IEEE Transactions on Human-Machine Systems
Abstract:Failures of the automated driving system (ADS) in automated vehicles (AVs) can damage driver–ADS cooperation (e.g., causing trust damage) and traffic safety. Researchers suggest infusing a human-like ability, active trust repair, into automated systems, to mitigate broken trust and other negative impacts resulting from their failures. Trust repair is regarded as a key ergonomic design in automated systems. Trust repair strategies (e.g., apology) are examined and supported by some evidence in controlled environments, however, rarely subjected to empirical evaluations in more naturalistic environments. To fill this gap, we conducted a test track study, invited participants (N = 257) to experience an ADS failure, and tested the influence of the ADS' trust repair on trust and other psychological responses. Half of participants (n = 128) received the ADS' verbal message (consisting of apology, explanation, and promise) by a human voice (n = 63) or by Apple's Siri (n = 65) after its failure. We measured seven psychological responses to AVs and ADS [e.g., trust and behavioral intention (BI)]. We found that both strategies cannot repair damaged trust. The human-voice-repair strategy can to some degree mitigate other detrimental influences (e.g., reductions in BI) resulting from the ADS failure, but this effect is only notable among participants without substantial driving experience. It points to the importance of conducting ecologically valid and field studies for validating human-like trust repair strategies in human–automation interaction and of developing trust repair strategies specific to safety-critical situations.
computer science, cybernetics, artificial intelligence