Abstract:Driver's lane changing maneuver prediction holds significant importance in enhancing the functionality of the Advanced Driver Assistance System (ADAS) and ensuring driving safety. This study introduces an innovative approach to model the driver's spatio-temporal gaze attention to the traffic environment, and realizes highprecision lane changing prediction by integrating multi-source inputs. Firstly, a naturalistic driving dataset containing information of the ego vehicle, the traffic environment, and the driver's eye movements is created based on the real-vehicle apparatus. Secondly, the driver's gaze attention to the traffic environment is creatively modeled by introducing a gaze cone and quantified by using spatio-temporal indexes. Concurrently, vehicle dynamic inputs and traffic environmental inputs including the information of surrounding vehicles and the lane are also constructed. Thirdly, a Transformer Encoder model, containing the multi-head attention mechanism, is established to extract the information from input sequences for maneuver prediction. Performance comparison is carried out using various historical horizons, input combinations, and prediction horizons. The model shows an enhanced prediction performance after adding gaze attention inputs, with the accuracy, precision, recall, F1score, and Area Under Curve (AUC) being 0.945, 0.937, 0.931, 0.934, and 0.986, respectively. In addition, as the prediction horizon extends from 1 s to 3 s, the model utilizing multi-source inputs consistently demonstrates the highest accuracy and minimal performance decline, exhibiting stable predictive capabilities. In future application, the proposed driver's gaze attention model can serve to alert drivers about unobserved objects, and the maneuver prediction method shows promise for the integration into lane change assistance systems.

AGCNNs: Attention-guided Convolutional Neural Networks for Infrared Head Pose Estimation in Assisted Driving System

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Autonomous Driving with Human Guided Image Feature Extraction

NGDNet: Nonuniform Gaussian-label distribution learning for infrared head pose estimation and on-task behavior understanding in the classroom

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

Estimation of Head Orientation for Safe Driving

Driver Pose Estimation by Hybrid Convolutional Network Architecture

Single Camera Face Position-Invariant Driver's Gaze Zone Classifier Based on Frame-Sequence Recognition Using 3D Convolutional Neural Networks

What Do You See in Vehicle? Comprehensive Vision Solution for In-Vehicle Gaze Estimation

ARHPE: Asymmetric Relation-aware Representation Learning for Head Pose Estimation in Industrial Human-machine Interaction

Driver's Gaze Zone Estimation Method: A Four-channel Convolutional Neural Network Model.

HybridGazeNet: Geometric model guided Convolutional Neural Networks for gaze estimation

Real-Time Monocular Joint Perception Network for Autonomous Driving

Deep Unsupervised Homography Estimation for Single-Resolution Infrared and Visible Images Using GNN

Visual Recognition of traffic police gestures with convolutional pose machine and handcrafted features

Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home

GSA-Gaze: Generative Self-adversarial Learning for Domain Generalized Driver Gaze Estimation

Lane Changing Maneuver Prediction by Using Driver’s Spatio-Temporal Gaze Attention Inputs for Naturalistic Driving

Automatic Calibration Method for Driver's Head Orientation in Natural Driving Environment