Abstract:Driver's lane changing maneuver prediction holds significant importance in enhancing the functionality of the Advanced Driver Assistance System (ADAS) and ensuring driving safety. This study introduces an innovative approach to model the driver's spatio-temporal gaze attention to the traffic environment, and realizes highprecision lane changing prediction by integrating multi-source inputs. Firstly, a naturalistic driving dataset containing information of the ego vehicle, the traffic environment, and the driver's eye movements is created based on the real-vehicle apparatus. Secondly, the driver's gaze attention to the traffic environment is creatively modeled by introducing a gaze cone and quantified by using spatio-temporal indexes. Concurrently, vehicle dynamic inputs and traffic environmental inputs including the information of surrounding vehicles and the lane are also constructed. Thirdly, a Transformer Encoder model, containing the multi-head attention mechanism, is established to extract the information from input sequences for maneuver prediction. Performance comparison is carried out using various historical horizons, input combinations, and prediction horizons. The model shows an enhanced prediction performance after adding gaze attention inputs, with the accuracy, precision, recall, F1score, and Area Under Curve (AUC) being 0.945, 0.937, 0.931, 0.934, and 0.986, respectively. In addition, as the prediction horizon extends from 1 s to 3 s, the model utilizing multi-source inputs consistently demonstrates the highest accuracy and minimal performance decline, exhibiting stable predictive capabilities. In future application, the proposed driver's gaze attention model can serve to alert drivers about unobserved objects, and the maneuver prediction method shows promise for the integration into lane change assistance systems.

A Data-Driven Long-Term Prediction Method of Mandatory and Discretionary Lane Change Based on Transformer

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Lane Change Detection and Prediction Using Real-World Connected Vehicle Data

Predictive Analysis of Vehicular Lane Changes: an Integrated LSTM Approach

Long-Term Prediction of Lane Change Maneuver Through a Multilayer Perceptron

Lane Changing Maneuver Prediction by Using Driver’s Spatio-Temporal Gaze Attention Inputs for Naturalistic Driving

Enhancing lane changing trajectory prediction on highways: A heuristic attention-based encoder-decoder model

Driver Lane Change Intention Recognition of Intelligent Vehicle Based on Long Short-Term Memory Network

Lane Change Trajectory Prediction Based on Spatiotemporal Attention Mechanism

End-to-end Lane Shape Prediction with Transformers

Dual Transformer Based Prediction for Lane Change Intentions and Trajectories in Mixed Traffic Environment

Early Lane Change Prediction for Automated Driving Systems Using Multi-Task Attention-based Convolutional Neural Networks

Research on Vehicle Mandatory Lane Change Decision Model Based on Trajectory Analysis

A Data-Driven Lane-Changing Model Based on Deep Learning

A Lane-Changing Prediction Method Based on Temporal Convolution Network

Direction Convolutional LSTM Network: Prediction Network for Drivers’ Lane-Changing Behaviours

Lane-change intention recognition considering oncoming traffic: Novel insights revealed by advances in deep learning

Lane-changing trajectory prediction based on multi-task learning

Lane-Changing Risk Level Prediction Considering Dynamic Decision Process: A Deep Learning Method Based on Spatial-Temporal Series Characteristics

Attention-Based Lane Change and Crash Risk Prediction Model in Highways

Long-term prediction for high-resolution lane-changing data using temporal convolution network