Abstract:The acquisition of the Driver‐vid video optical flow dataset and Driver‐img image optical flow dataset involves Recurrent All‐Pairs Field Transforms dense optical flow analysis, accentuating the semantic aspects of driver actions. The Driver‐img dataset is used to train the feature extraction network MobileNet‐GYY to extract image features from the first 64 frames of the Driver‐vid video dataset (less than 64 frames to extract all frames). Subsequently, a compressed padding method is employed to standardize the data format of the video feature tensor, which is then input to the bidirectional GRU model. Ultimately, the fully connected layer yields ten driver behaviour tensor categories, and the model is optimized using the cross‐entropy loss function. To standardize driver behaviour and enhance transportation system safety, a dynamic driver behaviour recognition method based on the Recurrent All‐Pairs Field Transforms (RAFT) temporal model is proposed. This study involves the creation of two datasets, namely, Driver‐img and Driver‐vid, including driver behaviour images and videos across various scenarios. These datasets are subject to preprocessing using RAFT optical flow techniques to enhance the cognitive process of the network. This approach employs a two‐stage temporal model for driver behaviour recognition. In the initial stage, the MobileNet network is optimized and the GYY module is introduced, which includes residuals and global average pooling layers, thereby enhancing the network's feature extraction capabilities. In the subsequent stage, a bidirectional GRU network is constructed to learn driver behaviour video features with temporal information. Additionally, a method for compressing and padding video frames is proposed, which serves as input to the GRU network and enables intent prediction 0.2 s prior to driver actions. Model performance is assessed through accuracy, recall, and F1 score, with experimental results indicating that RAFT preprocessing enhances accuracy, reduces training time, and improves overall model stability, facilitating the recognition of driver behaviour intent.

An Enhanced Driver's Risk Perception Modeling Based on Gate Recurrent Unit Network.

Modeling Driver Risk Perception on City Roads Using Deep Learning

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

A Multimodal Data-Driven Approach for Driving Risk Assessment

Driver-Specific Risk Recognition in Interactive Driving Scenarios Using Graph Representation

A Deep Learning Based Model for Driving Risk Assessment

Sensor-based Risk Perception Ability Network Design for Drivers in Snow and Ice Environmental Freeway: a Deep Learning and Rough Sets Approach

A Deep Multichannel Network Model for Driving Behavior Risk Classification

Passenger hazard perception based on EEG signals for highly automated driving vehicles

How Do Drivers Respond to Driving Risk During Car-Following? Risk-response Driver Model and Its Application in Human-Like Longitudinal Control

Driving Risk Detection Model of Deceleration Zone in Expressway Based on Generalized Regression Neural Network

Towards Efficient Risky Driving Detection: A Benchmark and a Semi-Supervised Model

A Traffic Accident Risk Prediction Model Based on Spatial Gated Memory Network

Predict the risk feeling for drivers of autonomous cars: an application of deep learning methods

Time to Lane Change and Completion Prediction Based on Gated Recurrent Unit Network

A probabilistic risk assessment framework considering lane-changing behavior interaction

A hybrid neural network for driving behavior risk prediction based on distracted driving behavior data

Driving risk assessment under the connected vehicle environment: A CNN-LSTM modeling approach

Driver behaviour recognition based on recursive all‐pair field transform time series model

Deformation Gated Recurrent Network for Lane-Level Abnormal Driving Behavior Recognition