Abstract:Transportation Research Record, Ahead of Print. In-vehicle infotainment systems can increase cognitive load and impair driving performance. These effects can be alleviated through interfaces that can assess cognitive load and adapt accordingly. Eye-tracking and physiological measures that are sensitive to cognitive load, such as pupil diameter, gaze dispersion, heart rate (HR), and galvanic skin response (GSR), can enable cognitive load estimation. The advancement in cost-effective and nonintrusive sensors in wearable devices provides an opportunity to enhance driver state detection by fusing eye-tracking and physiological measures. As a preliminary investigation of the added benefits of utilizing physiological data along with eye-tracking data in driver cognitive load detection, this paper explores the performance of several machine learning models in classifying three levels of cognitive load imposed on 33 drivers in a driving simulator study: no external load, lower difficulty 1-back task, and higher difficulty 2-back task. We built five machine learning models, including k-nearest neighbor, support vector machine, feedforward neural network, recurrent neural network, and random forest (RF) on (1) eye-tracking data only, (2) HR and GSR, (3) eye-tracking and HR, (4) eye-tracking and GSR, and (5) eye-tracking, HR, and GSR. Although physiological data provided 1%–15% lower classification accuracies compared with eye-tracking data, adding physiological data to eye-tracking data increased model accuracies, with an RF classifier achieving 97.8% accuracy. GSR led to a larger boost in accuracy (29.3%) over HR (17.9%), with the combination of the two factors boosting accuracy by 34.5%. Overall, utilizing both physiological and eye-tracking measures shows promise for driver state detection applications.

Physiological Measurement Used In Real Time Experiment To Detect Driver Cognitive Distraction

<italic>DetectDUI</italic>: An In-Car Detection System for Drink Driving and BACs

Non Intrusive Physiological Measurement for Driver Cognitive Distraction Detection: Eye and Mouth Movements

Detection of Driver Cognitive Distraction: an SVM Based Real-Time Algorithm and Its Comparison Study in Typical Driving Scenarios.

Driver distraction detection and recognition using RGB-D sensor

Detecting Driver Cognition Alertness State from Visual Activities in Normal and Emergency Scenarios.

Driver Attention Assessment Using Physiological Measures from EEG, ECG, and EDA Signals

Facial Expression Measurement for Detecting Driver Drowsiness

Eye and mouth movements extraction for driver cognitive distraction detection

An Experimental Study on Physiological Parameters Toward Driver Emotion Recognition

Physiological and Physical Sensors for Stress Level, Drowsiness Detection, and Behaviour Analysis

Detecting driver distraction using stimuli-response EEG analysis

Heatmap-Based Method for Estimating Drivers' Cognitive Distraction

Classification of Driver Cognitive Load: Exploring the Benefits of Fusing Eye-Tracking and Physiological Measures

Detection of distracted driving through the analysis of real-time driver, vehicle, and roadway volatilities

Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences

Monitoring driver distraction using machine learning and deep learning techniques

Multimodal Driver Condition Monitoring System Operating in the Far-Infrared Spectrum

Multimodal Estimation of Change Points of Physiological Arousal in Drivers

Detecting driving stress in physiological signals based on multimodal feature analysis and kernel classifiers

An Empirical Study to Examine Sex Differences in Cognitive Distraction among Drivers