Abstract:Some studies provide evidence that humans could actively exploit the alleged technological advantages of autonomous vehicles (AVs). This implies that humans may tend to interact differently with AVs as compared to human driven vehicles (HVs) with the knowledge that AVs are programmed to be risk-averse. Hence, it is important to investigate how humans interact with AVs in complex traffic situations. Here, we investigated whether participants would value interactions with AVs differently compared to HVs, and if these differences can be characterized on the behavioral and brain-level. We presented participants with a cover story while recording whole-head brain activity using fNIRS that they were driving under time pressure through urban traffic in the presence of other HVs and AVs. Moreover, the AVs were programmed defensively to avoid collisions and had faster braking reaction times than HVs. Participants would receive a monetary reward if they managed to finish the driving block within a given time-limit without risky driving maneuvers. During the drive, participants were repeatedly confronted with left-lane turning situations at unsignalized intersections. They had to stop and find a gap to turn in front of an oncoming stream of vehicles consisting of HVs and AVs. While the behavioral results did not show any significant difference between the safety margin used during the turning maneuvers with respect to AVs or HVs, participants tended to be more certain in their decision-making process while turning in front of AVs as reflected by the smaller variance in the gap size acceptance as compared to HVs. Importantly, using a multivariate logistic regression approach, we were able to predict whether the participants decided to turn in front of HVs or AVs from whole-head fNIRS in the decision-making phase for every participant (mean accuracy = 67.2%, SD = 5%). Channel-wise univariate fNIRS analysis revealed increased brain activation differences for turning in front of AVs compared to HVs in brain areas that represent the valuation of actions taken during decision-making. The insights provided here may be useful for the development of control systems to assess interactions in future mixed traffic environments involving AVs and HVs.

Assessment of senior drivers' internal state in the event of simulated unexpected vehicle motion based on near-infrared spectroscopy

Near-Infrared Spectroscopy As A Tool For Driving Research

Analysis of Motion Sickness Associated Brain Activity Using Fnirs: A Driving Simulator Study

Driving-Induced Neurological Biomarkers in an Advanced Driver-Assistance System

A Passenger Reduces Sleepy Driver's Activation in the Right Prefrontal Cortex: A Laboratory Study Using Near-Infrared Spectroscopy.

Assessment of Cerebral Oxygen Saturation Using Near Infrared Spectroscopy under Driver Fatigue State

Study of Driver's Perception in Driving Tasks Based on Naturalistic Driving Experiments and fNIRS Measurement

Effects of an Unexpected and Expected Event on Older Adults' Autonomic Arousal and Eye Fixations During Autonomous Driving

Exploring the Brain Responses to Driving Fatigue Through Simultaneous EEG and fNIRS Measurements

Analysis of braking intention based on fNIRS in driving simulation experiments

A Spatial-Temporal Analysis of Brain Activation to Explain the Take-Over Failure in Conditionally Automated Driving

Driving risk cognition of passengers in highly automated driving based on the prefrontal cortex activity via fNIRS

Multimodal Driver State Modeling through Unsupervised Learning

Advancements in Fatigue Detection: Integrating fNIRS and Non-Voluntary Attention Brain Function Experiments

Prefrontal Correlates of Passengers’ Mental Activity Based on Fnirs for High-Level Automated Vehicles

Study protocol for "In-vehicle sensors to detect changes in cognition of older drivers"

Auditory neural correlates and neuroergonomics of driving assistance in a simulated virtual environment

Functional near-infrared spectroscopy in the evaluation of urban rail transit drivers' mental workload under simulated driving conditions

Investigating Differences in Behavior and Brain in Human-Human and Human-Autonomous Vehicle Interactions in Time-Critical Situations

Multimodal Driver Condition Monitoring System Operating in the Far-Infrared Spectrum

Evaluation of Driver's Brain Activity Associated with Advanced Driving Skills Such as Cornering