Abstract:To further advance driver monitoring and assistance systems, it is important to understand how drivers allocate their attention, in other words, where do they tend to look and why. Traditionally, factors affecting human visual attention have been divided into bottom-up (involuntary attraction to salient regions) and top-down (driven by the demands of the task being performed). Although both play a role in directing drivers' gaze, most of the existing models for drivers' gaze prediction apply techniques developed for bottom-up saliency and do not consider influences of the drivers' actions explicitly. Likewise, common driving attention benchmarks lack relevant annotations for drivers' actions and the context in which they are performed. Therefore, to enable analysis and modeling of these factors for drivers' gaze prediction, we propose the following: 1) we correct the data processing pipeline used in DR(eye)VE to reduce noise in the recorded gaze data; 2) we then add per-frame labels for driving task and context; 3) we benchmark a number of baseline and SOTA models for saliency and driver gaze prediction and use new annotations to analyze how their performance changes in scenarios involving different tasks; and, lastly, 4) we develop a novel model that modulates drivers' gaze prediction with explicit action and context information. While reducing noise in the DR(eye)VE gaze data improves results of all models, we show that using task information in our proposed model boosts performance even further compared to bottom-up models on the cleaned up data, both overall (by 24% KLD and 89% NSS) and on scenarios that involve performing safety-critical maneuvers and crossing intersections (by up to 10--30% KLD). Extended annotations and code are available at <a class="link-external link-https" href="https://github.com/ykotseruba/SCOUT" rel="external noopener nofollow">this https URL</a>.

Strabismus free gaze detection system for driver’s using deep learning technique

A Single-Camera Gaze Tracking System under Natural Light

Deep Learning-Based Gaze Detection System for Automobile Drivers Using a NIR Camera Sensor

Single Camera Face Position-Invariant Driver's Gaze Zone Classifier Based on Frame-Sequence Recognition Using 3D Convolutional Neural Networks

Driver's Gaze Zone Estimation Method: A Four-channel Convolutional Neural Network Model.

A Nonintrusive and Real-Time Classification Method for Driver’s Gaze Region Using an RGB Camera

Detecting Driver Cognition Alertness State from Visual Activities in Normal and Emergency Scenarios.

Deep learning–based eye tracking system to detect distracted driving

VigilEye -- Artificial Intelligence-based Real-time Driver Drowsiness Detection

Looking at the right stuff: Guided semantic-gaze for autonomous driving

Towards Evaluating Driver Fatigue with Robust Deep Learning Models

Owl and Lizard: Patterns of Head Pose and Eye Pose in Driver Gaze Classification

Vision-Based Driver’s Cognitive Load Classification Considering Eye Movement Using Machine Learning and Deep Learning

Understanding and Modeling the Effects of Task and Context on Drivers' Gaze Allocation

Driving Alert System based on Facial Expression Recognition

Gaze Estimation Using Neural Network And Logistic Regression

Where and What: Driver Attention-based Object Detection

A Real-Time Adaptive Learning Method for Driver Eye Detection

Dynamics of Driver's Gaze: Explorations in Behavior Modeling & Maneuver Prediction

Faster Single Model Vigilance Detection Based on Deep Learning

Accident Prevention by Detecting Drivers Fatigueness