Abstract:Anomalous driving behavior detection is becoming more popular since it is vital in ensuring the safety of drivers and passengers in vehicles. Road accidents happen for various reasons, including health, mental stress, and fatigue. It is critical to monitor abnormal driving behaviors in real time to improve driving safety, raise driver awareness of their driving patterns, and minimize future road accidents. Many symptoms appear to show this condition in the driver, such as facial expressions or abnormal actions. The abnormal activity was among the most common causes of road accidents, accounting for nearly 20% of all accidents, according to international data on accident causes. To avoid serious consequences, abnormal driving behaviors must be identified and avoided. As it is difficult to monitor anyone continuously, automated detection of this condition is more effective and quicker. To increase drivers' recognition of their driving behaviors and prevent potential accidents, a precise monitoring approach that detects abnormal driving behaviors and identifies abnormal driving behaviors is required. The most common activities performed by the driver while driving is drinking, eating, smoking, and calling. These types of driver activities are considered in this work, along with normal driving. This study proposed deep learning-based detection models for recognizing abnormal driver actions. This system is trained and tested using a newly created dataset, including five classes. The main classes include Driver-smoking, Driver-eating, Driver-drinking, Driver-calling, and Driver-normal. For the analysis of results, pre-trained and fine-tuned CNN models are considered. The proposed CNN-based model and pre-trained models ResNet101, VGG-16, VGG-19, and Inception-v3 are used. The results are compared by using the performance measures. The results are obtained 89%, 93%, 93%, 94% for pre-trained models and 95% by using the proposed CNN-based model. Our analysis and results revealed that our proposed CNN base model performed well and could effectively classify the driver's abnormal behavior.

Driver behavior recognition based on deep convolutional neural networks

Application of Deep Learning Methods in Driver Behavior Recognition

Driver behavior detection and classification using deep convolutional neural networks

Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach

Video-based Driver Action Recognition Via Hybrid Spatial–temporal Deep Learning Framework

Attention-based deep neural network for driver behavior recognition

Long Short‐term Memory and Convolutional Neural Network for Abnormal Driving Behaviour Recognition

Driving Behaviour Recognition from Still Images by Using Multi-Stream Fusion CNN.

Driver Action Recognition Based on Attention Mechanism.

Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets With Multi-Stream Inputs

End-to-End Driving Activities and Secondary Tasks Recognition Using Deep Convolutional Neural Network and Transfer Learning

Recognition method of abnormal driving behavior using the bidirectional gated recurrent unit and convolutional neural network

Advancing Driver Behavior Recognition: an Intelligent Approach Utilizing ResNet

Attention-Based Convolutional and Recurrent Neural Networks for Driving Behavior Recognition Using Smartphone Sensor Data

An abnormal driving behavior recognition algorithm based on the temporal convolutional network and soft thresholding

Driver Detection Based on Deep Learning

Risky-Driving-Image Recognition Based on Visual Attention Mechanism and Deep Learning

RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network

A Novel Method for Unsafe Driving States Detection

Unusual Driver Behavior Detection in Videos Using Deep Learning Models

Learning Driver-Irrelevant Features for Generalizable Driver Behavior Recognition