Abstract:Maintaining situation awareness (SA) is essential for drivers to deal with the situations that Society of Automotive Engineers (SAE) Level 3 automated vehicle systems are not designed to handle. Although advanced physiological sensors can enable continuous SA assessments, previous single-modality approaches may not be sufficient to capture SA. To address this limitation, the current study demonstrates a multimodal sensing approach for objective SA monitoring. Physiological sensor data from electroencephalogram and eye-tracking were recorded for 30 participants as they performed three secondary tasks during automated driving scenarios that consisted of a pre-takeover (pre-TOR) request segment and a post-TOR segment. The tasks varied in terms of how visual attention was allocated in the pre-TOR segment. In the post-TOR segment, drivers were expected to gather information from the driving environment in preparation for a vehicle-to-driver transition. Participants' ground-truth SA level was measured using the Situation Awareness Global Assessment Techniques (SAGAT) after the post-TOR segment. A total of 23 physiological features were extracted from the post-TOR segment to train computational intelligence models. Results compared the performance of five different classifiers, the ground-truth labeling strategies, and the features included in the model. Overall, the proposed neural network model outperformed other machine learning models and achieved the best classification accuracy (90.6%). A model with 11 features was optimal. In addition, the multi-physiological sensor-model outperformed the single sensing model by comparing prediction performance. Our results suggest that multimodal sensing model can objectively predict SA. The results of this study provide new insight into how physiological features contribute to the SA assessment.

Comparison of a Logistic and SVM Model to Detect Discomfort in Automated Driving

Study on physiological representation of passenger cognitive comfort: An example with overtaking scenarios

Measuring Driver Discomfort in Autonomous Vehicles

Research on the Comfort of Vehicle Passengers Considering the Vehicle Motion State and Passenger Physiological Characteristics: Improving the Passenger Comfort of Autonomous Vehicles

A Comfort Analysis Model based on SVM Computation

Detection of Driver Cognitive Distraction: an SVM Based Real-Time Algorithm and Its Comparison Study in Typical Driving Scenarios.

Measuring Drivers' Physiological Response to Different Vehicle Controllers in Highly Automated Driving (HAD): Opportunities for Establishing Real-Time Values of Driver Discomfort

Intelligent Car Cockpit Comfort Evaluation Model Based on SVM

Measuring Drivers’ Physiological Response to Different Vehicle Controllers in Highly Automated Driving (HAD): Opportunities for Establishing Real-Time Values of Driver Discomfort

Comfort or Not? Automated Driving Style and User Characteristics Causing Human Discomfort in Automated Driving

Multimodal Sensing and Computational Intelligence for Situation Awareness Classification in Autonomous Driving

Can Variations of Vehicle Driving Status Provide Accurate Predictors of Discomfort? A Study on the Actual Driving Test

Classification of Driver Cognitive Load: Exploring the Benefits of Fusing Eye-Tracking and Physiological Measures

Identification of Adaptive Driving Style Preference through Implicit Inputs in SAE L2 Vehicles

Improving automatic detection of driver fatigue and distraction using machine learning

Passenger Response to Driving Style in an Autonomous Vehicle

KomfoPilot—Comfortable Automated Driving

Driver Drowsiness Detection with Eyelid Related Parameters by Support Vector Machine

Motion Sickness Detection for Intelligent Vehicles: A Wearable-Device-Based Approach

Machine Learning Based Driver Emotion Monitoring for Vehicular IoT

Multi-Dimensional and Objective Assessment of Motion Sickness Susceptibility Based on Machine Learning