Abstract:Traditional methodologies for measuring visual distraction have been limiting in their approaches, treating distraction as a one-dimensional variable. This has been accomplished either by categorizing distraction as a binary variable or using surrogate measurements, such as reaction time in response to non-driving related tasks, which follow the procedures of measuring distraction from psychology. Furthermore, as human-vehicle interaction (HVI) under automated driving has the potential to provide safety information and bring visual distraction simultaneously, there lacks an investigation on the quantitative relationship between distraction and safety due to the restrained methodologies in measuring visual distraction. As HVI-induced driver distraction plays a critical role in determining safe driving under automated driving, a methodology is highly needed to comprehensively measure the visual distraction under automated driving so that its impact on safety can be further investigated. Therefore, sticking to the definition of visual distraction, this research aims to (1) improve the existing methodology in measuring HVI-induced driver distraction under automated driving by focusing on visual distraction and mathematically describing it from spatiotemporal and directional dimensions; (2) theoretically investigate how the quantified visual distraction influences driving safety and (3) quantify the relationship between distraction and safety with introducing the "distraction-safety" ratio. Drivers' fixation behaviors are used in quantifying visual distraction, which is measured by spatiotemporal and directional relationships between drivers' visual attention and the attention that indicates "zero distraction". Three newly added performance measures in quantifying HVI-induced visual distraction are real-time magnitudes, real-time directions, and intensities (cumulation of magnitudes over time). To validate the proposed methods, a verification study was conducted by recruiting drivers to test automated driving under Level 3 automation. Drivers are required to wear an eye-tracker and go through two scenarios interacting with jaywalkers where takeover actions are needed with two takeover warnings ("visual-only" and "visual & audible"). Per past studies, takeover time was measured in representing distraction level. As a result, this study confirms the validity of the proposed methods by revealing the significant and positive correlations between the measured distraction intensity and the takeover time. Discussions of the quantified visual distraction from the spatiotemporal and directional perspective further enhance the understanding of HVI-induced driver distraction under automated driving through multiple dimensions. Furthermore, this research reveals how distracted driving affects safety under automated driving through the takeover performance. Thresholds under visual distraction magnitudes and degrees that lead to traffic conflicts were identified. More importantly, a "distraction-safety" ratio that quantifies the relationship between visual distraction and safety benefits is proposed. The results suggest that the "visual & audible" is more effective in significantly enhancing safety while aggregating a significantly smaller amount of visual distraction. The contribution of this research is to re-define the methodological approach of measuring visual distraction by (1) measuring distraction multi-dimensionally and (2) establishing a "distraction-safety" system in quantitatively assessing the balance of safety benefits and the HVI-induced visual distraction magnitude under automated driving environment.

A Study on Driver Distraction Detection Technology Based on Computer Vision

Driver Distraction Detection Method Based on Continuous Head Pose Estimation

Estimation of Head Orientation for Safe Driving

A Nonintrusive and Real-Time Classification Method for Driver’s Gaze Region Using an RGB Camera

Driver distraction detection and recognition using RGB-D sensor

Advancements in the Intelligent Detection of Driver Fatigue and Distraction: A Comprehensive Review

Driver Distraction Behavior Detection Method Based on Deep Learning

Effective driver distraction warning system incorporating fast image recognition methods

Transitioning to multi-dimensional estimation of visual distraction and its safety effects under automated driving: A spatiotemporal and directional estimation approach

Risk prediction model for distracted driving: Characterizing interactions of eye glances and manual sequences

Improving automatic detection of driver fatigue and distraction using machine learning

Detection of Driver Cognitive Distraction: an SVM Based Real-Time Algorithm and Its Comparison Study in Typical Driving Scenarios.

A detection model for driver's unsafe states based on real-time face-vision

Driver inattention monitoring system based on multimodal fusion with visual cues to improve driving safety

Detection Method for Driver Fatigue with Computerized Vision

Driver Drowsiness Recognition Based on Computer Vision Technology

Time-Dependency-Aware Driver Distraction Detection Using Linear-Chain Conditional Random Fields.

Deep learning–based eye tracking system to detect distracted driving

Detecting Driver Cognition Alertness State from Visual Activities in Normal and Emergency Scenarios.

Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences

L-TLA: A Lightweight Driver Distraction Detection Method Based on Three-Level Attention Mechanisms