Abstract:Driving behavior classification is a critical component of social transportation systems and advanced driver assistance systems, and it has gained increasing attention in recent years. Accurate classification algorithms for driving behavior play a significant role in enhancing traffic safety, energy conservation, and related fields. In this article, we propose a novel driving behavior classification network named feature-attention- embedding-based multimodal-fusion driving-behavior-classification network (FMDNet). FMDNet incorporates eight types of data, including acceleration along the x-axis, y-axis, z-axis, roll angle, pitch angle, yaw angle, roadside image, and vehicle speed, to classify driving behavior. To effectively fuse features extracted from different modalities, taking into account their varying importance, we introduce the feature attention embedding-based fusion module (FAEF) as our fusion strategy. This fusion strategy enhances the network’s capability to capture meaningful features by incorporating two feature attention embedding units that delve deeper into the interplay between different modes. Furthermore, we provide further validation of the effectiveness of our approach through extensive ablation experiments to investigate and analyze the impact of various modal data on the classification of driving behavior. Our proposed FMDNet achieves state-of-the-art performance on the public UAH-DriveSet dataset, demonstrating its effectiveness with an impressive F1-score of 99.0%. Additionally, the robustness of our model is confirmed on distracted dataset, achieving a remarkable F1-score of 99.7%. The model’s outstanding performance on both the UAH-DriveSet dataset and the distracted-dataset highlights its capabilities and potential for real-world applications.

Multi-level Attention Fusion for Multimodal Driving Maneuver Recognition

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

MM-LMF: A Low-Rank Multimodal Fusion Dangerous Driving Behavior Recognition Method Based on FMCW Signals

Multi-Modality Cascaded Fusion Technology for Autonomous Driving

M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving

FMDNet: Feature-Attention-Embedding-Based Multimodal-Fusion Driving-Behavior-Classification Network

Sensor Fusion: Gated Recurrent Fusion to Learn Driving Behavior from Temporal Multimodal Data

Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

Spatial-Temporal Multimodal End-to-End Autonomous Driving.

Temporal Multimodal Fusion for Driver Behavior Prediction Tasks using Gated Recurrent Fusion Units

MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

Deep learning-based fusion networks with high-order attention mechanism for 3D object detection in autonomous driving scenarios

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

MultiFuser: Multimodal Fusion Transformer for Enhanced Driver Action Recognition

Multi-Modal Sensor Fusion-Based Deep Neural Network for End-to-End Autonomous Driving With Scene Understanding

Multi-Modal Attention Guided Real-Time Lane Detection

GLMDriveNet: Global–local Multimodal Fusion Driving Behavior Classification Network

MIMF: Mutual Information-Driven Multimodal Fusion

Multi-Modal and Multi-Scale Fusion 3D Object Detection of 4D Radar and LiDAR for Autonomous Driving