Abstract:With the level of automation increases in vehicles, such as conditional and highly automated vehicles (AVs), drivers are becoming increasingly out of the control loop, especially in unexpected driving scenarios. Although it might be not necessary to require the drivers to intervene on most occasions, it is still important to improve drivers’ situation awareness (SA) in unexpected driving scenarios to improve their trust in and acceptance of AVs. In this study, we conceptualized SA at the levels of perception (SA L1), comprehension (SA L2), and projection (SA L3), and proposed an SA level-based explanation framework based on explainable AI. Then, we examined the effects of these explanations and their modalities on drivers’ situational trust, cognitive workload, as well as explanation satisfaction. A three (SA levels: SA L1, SA L2 and SA L3) by two (explanation modalities: visual, visual + audio) between-subjects experiment was conducted with 340 participants recruited from Amazon Mechanical Turk. The results indicated that by designing the explanations using the proposed SA-based framework, participants could redirect their attention to the important objects in the traffic and understand their meaning for the AV system. This improved their SA and filled the gap of understanding the correspondence of AV’s behavior in the particular situations which also increased their situational trust in AV. The results showed that participants reported the highest trust with SA L2 explanations, although the mental workload was assessed higher in this level. The results also provided insights into the relationship between the amount of information in explanations and modalities, showing that participants were more satisfied with visual-only explanations in the SA L1 and SA L2 conditions and were more satisfied with visual and auditory explanations in the SA L3 condition. Finally, we found that the cognitive workload was also higher in SA L2, possibly because the participants were actively interpreting the results, consistent with a higher level of situational trust. These findings demonstrated that properly designed explanations, based on our proposed SA-based framework, had significant implications for explaining AV behavior in conditional and highly automated driving.

Visualizing imperfect situation detection and prediction in automated vehicles: Understanding users' perceptions via user-chosen scenarios

Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles

Effects of Uncertain Trajectory Prediction Visualization in Highly Automated Vehicles on Trust, Situation Awareness, and Cognitive Load

Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles

Fostering User Acceptance and Trust in Fully Automated Vehicles: Evaluating the Potential of Augmented Reality

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

A Situated Inspection of Autonomous Vehicle Acceptance – A Population Study in Virtual Reality

How to Display Vehicle Information to Users of Automated Vehicles When Conducting Non-Driving-Related Activities

AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies

An Open Road Evaluation of a Self-Driving Vehicle Human–Machine Interface Designed for Visually Impaired Users

Investigating the Effects of External Communication and Automation Behavior on Manual Drivers at Intersections

Investigating explanations in conditional and highly automated driving: The effects of situation awareness and modality

Designing user interfaces for partially automated Vehicles: Effects of information and modality on trust and acceptance

Critical voxel learning with vision transformer and derivation of logical AV safety assessment scenarios

Building Trust in Autonomous Vehicles: Role of Virtual Reality Driving Simulators in HMI Design

Procedure for the Safety Assessment of an Autonomous Vehicle Using Real-World Scenarios

Vehicle Automation Field Test: Impact on Driver Behavior and Trust

DAnoScenE: a driving anomaly scenario extraction framework for autonomous vehicles in urban streets

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

Defining, measuring, and modeling passenger's in-vehicle experience and acceptance of automated vehicles

Scenario-Based Safety Assessment Framework for Automated Vehicles