Abstract:Driver's lane changing maneuver prediction holds significant importance in enhancing the functionality of the Advanced Driver Assistance System (ADAS) and ensuring driving safety. This study introduces an innovative approach to model the driver's spatio-temporal gaze attention to the traffic environment, and realizes highprecision lane changing prediction by integrating multi-source inputs. Firstly, a naturalistic driving dataset containing information of the ego vehicle, the traffic environment, and the driver's eye movements is created based on the real-vehicle apparatus. Secondly, the driver's gaze attention to the traffic environment is creatively modeled by introducing a gaze cone and quantified by using spatio-temporal indexes. Concurrently, vehicle dynamic inputs and traffic environmental inputs including the information of surrounding vehicles and the lane are also constructed. Thirdly, a Transformer Encoder model, containing the multi-head attention mechanism, is established to extract the information from input sequences for maneuver prediction. Performance comparison is carried out using various historical horizons, input combinations, and prediction horizons. The model shows an enhanced prediction performance after adding gaze attention inputs, with the accuracy, precision, recall, F1score, and Area Under Curve (AUC) being 0.945, 0.937, 0.931, 0.934, and 0.986, respectively. In addition, as the prediction horizon extends from 1 s to 3 s, the model utilizing multi-source inputs consistently demonstrates the highest accuracy and minimal performance decline, exhibiting stable predictive capabilities. In future application, the proposed driver's gaze attention model can serve to alert drivers about unobserved objects, and the maneuver prediction method shows promise for the integration into lane change assistance systems.

Driver attention prediction based on convolution and transformers

TransConvNet: Perform perceptually relevant driver's visual attention predictions

FBLNet: FeedBack Loop Network for Driver Attention Prediction

Recent advancements in driver's attention prediction

Where and What: Driver Attention-based Object Detection

Improving real-time driver distraction detection via constrained attention mechanism

Gated Driver Attention Predictor

STDA: Spatio-Temporal Dual-Encoder Network Incorporating Driver Attention to Predict Driver Behaviors Under Safety-Critical Scenarios

A lightweight model combining convolutional neural network and Transformer for driver distraction recognition

A Hybrid Approach for Driving Behavior Recognition: Integration of CNN and Transformer-Encoder with EEG Data

SADNet: Sustained Attention Decoding in a Driving Task by Self-Attention Convolutional Neural Network

Driver lane change intention prediction based on topological graph constructed by driver behaviors and traffic context for human-machine co-driving system

AHMF: Adaptive Hybrid-Memory-Fusion Model for Driver Attention Prediction

Improved Attention Mechanism for Human-like Intelligent Vehicle Trajectory Prediction

Driving Maneuvers Prediction Based on Cognition-Driven and Data-Driven Method.

Driver Vigilance Detection from EEG Signals Using Transformer Networks

Target-point Attention Transformer: A novel trajectory predict network for end-to-end autonomous driving

When Do Drivers Concentrate? Attention-based Driver Behavior Modeling With Deep Reinforcement Learning

Lane Changing Maneuver Prediction by Using Driver’s Spatio-Temporal Gaze Attention Inputs for Naturalistic Driving

Multimodal driver distraction detection using dual-channel network of CNN and Transformer

Improving Driver Gaze Prediction With Reinforced Attention