Abstract:With the level of automation increases in vehicles, such as conditional and highly automated vehicles (AVs), drivers are becoming increasingly out of the control loop, especially in unexpected driving scenarios. Although it might be not necessary to require the drivers to intervene on most occasions, it is still important to improve drivers’ situation awareness (SA) in unexpected driving scenarios to improve their trust in and acceptance of AVs. In this study, we conceptualized SA at the levels of perception (SA L1), comprehension (SA L2), and projection (SA L3), and proposed an SA level-based explanation framework based on explainable AI. Then, we examined the effects of these explanations and their modalities on drivers’ situational trust, cognitive workload, as well as explanation satisfaction. A three (SA levels: SA L1, SA L2 and SA L3) by two (explanation modalities: visual, visual + audio) between-subjects experiment was conducted with 340 participants recruited from Amazon Mechanical Turk. The results indicated that by designing the explanations using the proposed SA-based framework, participants could redirect their attention to the important objects in the traffic and understand their meaning for the AV system. This improved their SA and filled the gap of understanding the correspondence of AV’s behavior in the particular situations which also increased their situational trust in AV. The results showed that participants reported the highest trust with SA L2 explanations, although the mental workload was assessed higher in this level. The results also provided insights into the relationship between the amount of information in explanations and modalities, showing that participants were more satisfied with visual-only explanations in the SA L1 and SA L2 conditions and were more satisfied with visual and auditory explanations in the SA L3 condition. Finally, we found that the cognitive workload was also higher in SA L2, possibly because the participants were actively interpreting the results, consistent with a higher level of situational trust. These findings demonstrated that properly designed explanations, based on our proposed SA-based framework, had significant implications for explaining AV behavior in conditional and highly automated driving.

People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior: Insights from Cognitive Science for Explainable AI

Incorporating Explanations into Human-Machine Interfaces for Trust and Situation Awareness in Autonomous Vehicles

Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions

Good Explanations in Explainable Artificial Intelligence (XAI): Evidence from Human Explanatory Reasoning

The Who in XAI: How AI Background Shapes Perceptions of AI Explanations

A Human-Centric Method for Generating Causal Explanations in Natural Language for Autonomous Vehicle Motion Planning

Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review

Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving

Investigating explanations in conditional and highly automated driving: The effects of situation awareness and modality

Confident Teacher, Confident Student? A Novel User Study Design for Investigating the Didactic Potential of Explanations and their Impact on Uncertainty

Why did the AI make that decision? Towards an explainable artificial intelligence (XAI) for autonomous driving systems

Explainable Interface for Human-Autonomy Teaming: A Survey

Designing Theory-Driven User-Centric Explainable AI

Mindful Explanations: Prevalence and Impact of Mind Attribution in XAI Research

Evaluating the Impact of Human Explanation Strategies on Human-AI Visual Decision-Making

User-centric evaluation of explainability of AI with and for humans: a comprehensive empirical study

Critical Roles of Explainability in Shaping Perception, Trust, and Acceptance of Autonomous Vehicles

Effects of Explanation Specificity on Passengers in Autonomous Driving

Explainable deep learning improves human mental models of self-driving cars

Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanations