Abstract:Video surveillance is an effective tool for traffic management and safety, but it may face challenges in extreme weather, low visibility, areas outside the monitoring field of view, or during nighttime conditions. Therefore, abnormal sound detection is used in traffic management and safety as an auxiliary tool to complement video surveillance. In this paper, a novel lightweight method for abnormal sound detection based on 1D CNN and Multi-Head Self-Attention Mechanism on the embedded system is proposed, which is named HADNet. First, 1D CNN is employed for local feature extraction, which minimizes information loss from the audio signal during time-frequency conversion and reduces computational complexity. Second, the proposed block based on Multi-Head Self-Attention Mechanism not only effectively mitigates the issue of disappearing gradients, but also enhances detection accuracy. Finally, the joint loss function is employed to detect abnormal audio. This choice helps address issues related to unbalanced training data and class overlap, thereby improving model performance on imbalanced datasets. The proposed HADNet method was evaluated on the MIVIA Road Events and UrbanSound8K datasets. The results demonstrate that the proposed method for abnormal audio detection on embedded systems achieves high accuracy of 99.6% and an efficient detection time of 0.06 s. This approach proves to be robust and suitable for practical applications in traffic management and safety. By addressing the challenges posed by traditional video surveillance methods, HADNet offers a valuable and complementary solution for enhancing safety measures in diverse traffic conditions.

Detecting Road Surface Wetness from Audio: A Deep Learning Approach

Deep Convolutional Neural Network for Roadway Incident Surveillance Using Audio Data

Pavement type and wear condition classification from tire cavity acoustic measurements with artificial neural networks

Embedded System for Road Damage Detection by Deep Convolutional Neural Network

Artificial Intelligence for road quality assessment in smart cities: a machine learning approach to acoustic data analysis

A Deep Wavelet-Fourier Method for Monaural Vehicle Speed Estimation in Real-Life Settings

Detection of Water on Road Surface with Acoustic Vector Sensor

SmartRSD: An Intelligent Multimodal Approach to Real-Time Road Surface Detection for Safe Driving

Pavement surface defect recognition method based on vehicle system vibration data and feedforward neural network

Road Surface Anomaly Assessment Using Low-Cost Accelerometers: A Machine Learning Approach

HADNet: A Novel Lightweight Approach for Abnormal Sound Detection on Highway Based on 1D Convolutional Neural Network and Multi-Head Self-Attention Mechanism

Road type classification using deep learning for Tire-Pavement interaction noise data in autonomous driving vehicle

Estimation of Water Depth on Road Surfaces Using Accelerometric Signals

A Comprehensive Implementation of Road Surface Classification for Vehicle Driving Assistance: Dataset, Models, and Deployment

Road Surface Real-Time Detection Based on Raspberry Pi and Recurrent Neural Networks

Statistical Analysis Of Acoustic Measurements For Assessing Pavement Surface Condition

Road Roughness Estimation Using Machine Learning

Real-Time Vehicle Sound Detection System Based on Depthwise Separable Convolution Neural Network and Spectrogram Augmentation

Airborne Sound Analysis for the Detection of Bearing Faults in Railway Vehicles with Real-World Data

Application of the Semi-Supervised Learning Approach for Pavement Defect Detection

Acceleration-Guided Acoustic Signal Denoising Framework Based on Learnable Wavelet Transform Applied to Slab Track Condition Monitoring