Abstract:Driving behavior classification is a critical component of social transportation systems and advanced driver assistance systems, and it has gained increasing attention in recent years. Accurate classification algorithms for driving behavior play a significant role in enhancing traffic safety, energy conservation, and related fields. In this article, we propose a novel driving behavior classification network named feature-attention- embedding-based multimodal-fusion driving-behavior-classification network (FMDNet). FMDNet incorporates eight types of data, including acceleration along the x-axis, y-axis, z-axis, roll angle, pitch angle, yaw angle, roadside image, and vehicle speed, to classify driving behavior. To effectively fuse features extracted from different modalities, taking into account their varying importance, we introduce the feature attention embedding-based fusion module (FAEF) as our fusion strategy. This fusion strategy enhances the network’s capability to capture meaningful features by incorporating two feature attention embedding units that delve deeper into the interplay between different modes. Furthermore, we provide further validation of the effectiveness of our approach through extensive ablation experiments to investigate and analyze the impact of various modal data on the classification of driving behavior. Our proposed FMDNet achieves state-of-the-art performance on the public UAH-DriveSet dataset, demonstrating its effectiveness with an impressive F1-score of 99.0%. Additionally, the robustness of our model is confirmed on distracted dataset, achieving a remarkable F1-score of 99.7%. The model’s outstanding performance on both the UAH-DriveSet dataset and the distracted-dataset highlights its capabilities and potential for real-world applications.

Lightweight Multimodal Feature Graph Convolutional Network for Dangerous Driving Behavior Detection

Graph Convolutional Networks (GCN)-Based Lightweight Detection Model for Dangerous Driving Behavior.

Fatigue Driving Facial Feature Detection Based on Lightweight Convolutional Neural Network

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

Long Short‐term Memory and Convolutional Neural Network for Abnormal Driving Behaviour Recognition

Video-Based Abnormal Driving Behavior Detection Via Deep Learning Fusions

Lightweight Dangerous Driving Action Recognition Using Graph Convolutional Broad Learning

Multimodal Vehicle Trajectory Prediction Based on Graph Convolutional Networks

MM-LMF: A Low-Rank Multimodal Fusion Dangerous Driving Behavior Recognition Method Based on FMCW Signals

GLMDriveNet: Global–local Multimodal Fusion Driving Behavior Classification Network

A Lightweight VK-Net Based on Motion Profiles for Hazardous Driving Scenario Identification

Incorporating bidirectional feature pyramid network and lightweight network: a YOLOv5-GBC distracted driving behavior detection model

Driving Behavior Recognition Algorithm Combining Attention Mechanism and Lightweight Network

Driver Activity Recognition Using Spatial‐temporal Graph Convolutional LSTM Networks with Attention Mechanism

RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network

A multi-aware graph convolutional network for driver drowsiness detection

Detecting Abnormal Driving Behaviors By Smartphone Sensors Based On Multi-Feature Convolutional Neural Network

Predicting Hazardous Driving Events Using Multi-Modal Deep Learning Based on Video Motion Profile and Kinematics Data

FMDNet: Feature-Attention-Embedding-Based Multimodal-Fusion Driving-Behavior-Classification Network

MF-YOLO: A Lightweight Method for Real-Time Dangerous Driving Behavior Detection