Abstract:Advanced driver assistances are becoming increasingly common in commercial cars, not only to assist but also to free drivers from manual driving whenever possible. Soon, drivers should be allowed to engage in non-driving-related tasks. The fact that responsibility for driving is shifting from humans to machines must be considered in the development of these assistances in order to guarantee safety and trust. In this article, we introduce AdVitam (for Advanced Driver-Vehicle Interaction to Make future driving safer), an autonomous system aiming at maintaining driver's situation awareness and optimizing takeover quality during conditionally automated driving. The information conveyed to drivers is dynamically adapted to achieve these goals, depending on the driving environment and the driver's physiological state. This system consists of three connected modules. The first module (Driver State) predicts the driver's state with machine learning and physiological signals as inputs. The second module (Supervision) uses different interfaces (a haptic seat, a personal device, and ambient lights) to maintain the drivers' situation awareness during the autonomous driving phases. The third module (Intervention) is a machine learning model that chooses the most appropriate combination among haptic, auditory, and visual modalities to request the driver to take over control and thus optimize takeover quality. To evaluate the system and each module independently, a preliminary user study with 35 drivers was conducted in a fixed-base driving simulator. All participants drove in two different environments (rural and urban). In addition, the activation of the Supervision and Intervention modules were manipulated as two between-subject factors. Results show that conveying information on the driving environment status through multimodal interfaces increases drivers' situation awareness (i.e.- better identification of potential problems in the environment) and trust in the automated vehicle. However, the system does not show positive outcomes on takeover quality. Besides, the Driver State module provided consistent predictions with the experimental manipulation. The system proposed in this paper could lead to better acceptance and safety when conditionally automated vehicles will be released by increasing drivers' trust during phases of automated driving.

Unconstrained design: improving multitasking with in-vehicle information systems through enhanced situation awareness

From Distraction to Action: Elevating Situation Awareness with Visual Assistance in Level 3 Autonomous Driving

A Contextual Multimodal System for Increasing Situation Awareness and Takeover Quality in Conditionally Automated Driving

Multimodal Cue Combinations: A Possible Approach to Designing In-Vehicle Takeover Requests for Semi-autonomous Driving

Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

Assessing driver distraction from in-vehicle information system: an on-road study exploring the effects of input modalities and secondary task types

Designing Human-machine Collaboration Interface Through Multimodal Combination Optimization to Improve Takeover Performance in Highly Automated Driving

Trust Calibration Through Perceptual and Predictive Information of the External Context in Autonomous Vehicle

Multitasking While Driving: How Drivers Self-Regulate Their Interaction with In-Vehicle Touchscreens in Automated Driving

"Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario

Designing Touchscreen Menu Interfaces for In-Vehicle Infotainment Systems: the Effect of Depth and Breadth Trade-off and Task Types on Visual-Manual Distraction

Shaping driver-vehicle interaction in autonomous vehicles: How the new in-vehicle systems match the human needs

What's on your mind? A Mental and Perceptual Load Estimation Framework towards Adaptive In-vehicle Interaction while Driving

In-Vehicle Information System and Driving Safety

Age-Related Differences in the Cognitive, Visual, and Temporal Demands of In-Vehicle Information Systems

Get Ready for Take-Overs: Using Head-Up Display for Drivers to Engage in Non-Driving-Related Tasks in Automated Vehicles

Automated Driving: Interactive Automation Control System to Enhance Situational Awareness in Conditional Automation

In-Vehicle Human Machine Interface: Investigating the Effects of Tactile Displays on Information Presentation in Automated Vehicles

The Effect of Touchscreen Layout Division on the Usability and Driving Safety of In-Vehicle Information Systems