A Transparency Paradox? Investigating the Impact of Explanation Specificity and Autonomous Vehicle Perceptual Inaccuracies on Passengers

Daniel Omeiza,Raunak Bhattacharyya,Marina Jirotka,Nick Hawes,Lars Kunze

2024-08-16

Abstract:Transparency in automated systems could be afforded through the provision of intelligible explanations. While transparency is desirable, might it lead to catastrophic outcomes (such as anxiety), that could outweigh its benefits? It's quite unclear how the specificity of explanations (level of transparency) influences recipients, especially in autonomous driving (AD). In this work, we examined the effects of transparency mediated through varying levels of explanation specificity in AD. We first extended a data-driven explainer model by adding a rule-based option for explanation generation in AD, and then conducted a within-subject lab study with 39 participants in an immersive driving simulator to study the effect of the resulting explanations. Specifically, our investigation focused on: (1) how different types of explanations (specific vs. abstract) affect passengers' perceived safety, anxiety, and willingness to take control of the vehicle when the vehicle perception system makes erroneous predictions; and (2) the relationship between passengers' behavioural cues and their feelings during the autonomous drives. Our findings showed that passengers felt safer with specific explanations when the vehicle's perception system had minimal errors, while abstract explanations that hid perception errors led to lower feelings of safety. Anxiety levels increased when specific explanations revealed perception system errors (high transparency). We found no significant link between passengers' visual patterns and their anxiety levels. Our study suggests that passengers prefer clear and specific explanations (high transparency) when they originate from autonomous vehicles (AVs) with optimal perceptual accuracy.

Human-Computer Interaction,Artificial Intelligence,Computers and Society,Machine Learning,Robotics

What problem does this paper attempt to address?

The paper attempts to address the issue of how different levels of explanation specificity in autonomous vehicles (AVs) affect passengers' perceived safety, anxiety, and willingness to take over the vehicle. Specifically, the researchers focus on:

1. **How different types of explanations (specific vs. abstract) affect passengers' perceived safety, anxiety, and willingness to take over the vehicle when the vehicle's perception system makes errors**:
- When the vehicle's perception system makes a few errors, do specific explanations make passengers feel safer?
- Does revealing perception system errors with specific explanations increase passengers' anxiety?
- In high-transparency AVs, do passengers develop a desire to take over the vehicle due to frequent error explanations?

2. **The relationship between passengers' behavioral cues (such as visual patterns) and their feelings**:
- Are passengers' visual behaviors (such as gaze points and eye movements) related to their anxiety?

Through these studies, the authors hope to determine the appropriate level of transparency (i.e., the specificity of explanations) in autonomous vehicles to ensure passenger safety and trust while avoiding negative emotions caused by excessive transparency.