Abstract:Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, Ahead of Print. In recent years, Sound Event Classification (SEC) is a remarkable field of computer audition research. The abilities to automatically capture and classify sound events are meaningful for expanding the auditory ability of autonomous vehicle in a complex driving environment. The Autonomous vehicles will encounter some special road conditions during driving, such as large truck occlusion, tunnels, and buildings that hinder radar detection. Therefore, the perception capabilities of on-board lidar, vision, and other sensors are impacted, resulting in a great threat to the safe driving of the car. At this time, auditory environment perception can provide auditory dimension information for the vehicle. However, with the increase of noise level, the SEC task of autonomous vehicle becomes seriously difficult. Traditional machine learning methods show weak robustness in the highly noisy environment. In this work, an autonomous vehicle Sound Event Classification (AVSEC) framework based on Spectrogram Image Features (SIFs) and Convolutional Neural Networks (CNN) algorithm is proposed to solve the SEC question. Further on, the ambulance, bus, civil defense siren, fire truck, screaming, etc. are taken as the research traffic sounds. Traffic Sound Datasets (TSD) are collected, augmented and customized. Then, directly connected channel (DCC) between convolutional blocks and Convolutional Block Attention Module (CBAM) are designed to optimize the neural network. Testing results show that the AVSEC system achieves an accuracy of 97.18%. Furthermore, the results of AVSEC and other machine learning methods are compared, which shows that the combination of SIFs and AVSEC-net provides better noise robustness and classification accuracy in AVSEC task. The sound classification algorithm designed in this paper, as an advanced auxiliary driving system for sound detection, can identify the sound types in the current traffic environment of the Autonomous vehicles, that is, the traffic scene category. The vehicle computer can remind the driver to pay attention to driving safety through the above sound types, so as to improve the safety of the driver and the vehicle.

Real-Time Emergency Vehicle Detection using Mel Spectrograms and Regular Expressions

Emergency Vehicle Classification Using Combined Temporal and Spectral Audio Features with Machine Learning Algorithms

Implementation of Abnormal Sound Detection in Intelligent Surveillance Front-end System

Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion

Real-Time Vehicle Sound Detection System Based on Depthwise Separable Convolution Neural Network and Spectrogram Augmentation

Few-Shot Emergency Siren Detection

Frequency Tracking Features for Data-Efficient Deep Siren Identification

An advanced multimodal driver-assistance prototype for emergency-vehicle detection

A Wearable Assistant Device for the Hearing Impaired to Recognize Emergency Vehicle Sirens with Edge Computing

RTAIAED: A Real-Time Ambulance in an Emergency Detector with a Pyramidal Part-Based Model Composed of MFCCs and YOLOv8

Deep Convolutional Neural Network for Roadway Incident Surveillance Using Audio Data

Sound Event Detection for Human Safety and Security in Noisy Environments

A Traffic Accident Detection Algorithm Based on Audio Signal Processing

CARgram: CNN-based accident recognition from road sounds through intensity-projected spectrogram analysis

Smart City Traffic Management: Acoustic-Based Vehicle Detection Using Stacking-Based Ensemble Deep Learning Approach

pDenoiser: A Personalized Speech Enhancement Neural Network for Pre-hospital Emergency Medical Services.

Enhancing Situational Awareness with VAS-Compass Net for the Recognition of Directional Vehicle Alert Sounds

HADNet: A Novel Lightweight Approach for Abnormal Sound Detection on Highway Based on 1D Convolutional Neural Network and Multi-Head Self-Attention Mechanism

An Adaptive Speech Enhancement Method for Siren Noise Cancellation

A safety-oriented framework for sound event detection in driving scenarios

Improved convolutional neural network and spectrogram image feature for traffic sound event classification