Abstract:Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, Ahead of Print. In recent years, Sound Event Classification (SEC) is a remarkable field of computer audition research. The abilities to automatically capture and classify sound events are meaningful for expanding the auditory ability of autonomous vehicle in a complex driving environment. The Autonomous vehicles will encounter some special road conditions during driving, such as large truck occlusion, tunnels, and buildings that hinder radar detection. Therefore, the perception capabilities of on-board lidar, vision, and other sensors are impacted, resulting in a great threat to the safe driving of the car. At this time, auditory environment perception can provide auditory dimension information for the vehicle. However, with the increase of noise level, the SEC task of autonomous vehicle becomes seriously difficult. Traditional machine learning methods show weak robustness in the highly noisy environment. In this work, an autonomous vehicle Sound Event Classification (AVSEC) framework based on Spectrogram Image Features (SIFs) and Convolutional Neural Networks (CNN) algorithm is proposed to solve the SEC question. Further on, the ambulance, bus, civil defense siren, fire truck, screaming, etc. are taken as the research traffic sounds. Traffic Sound Datasets (TSD) are collected, augmented and customized. Then, directly connected channel (DCC) between convolutional blocks and Convolutional Block Attention Module (CBAM) are designed to optimize the neural network. Testing results show that the AVSEC system achieves an accuracy of 97.18%. Furthermore, the results of AVSEC and other machine learning methods are compared, which shows that the combination of SIFs and AVSEC-net provides better noise robustness and classification accuracy in AVSEC task. The sound classification algorithm designed in this paper, as an advanced auxiliary driving system for sound detection, can identify the sound types in the current traffic environment of the Autonomous vehicles, that is, the traffic scene category. The vehicle computer can remind the driver to pay attention to driving safety through the above sound types, so as to improve the safety of the driver and the vehicle.

IDMT-Traffic: An Open Benchmark Dataset for Acoustic Traffic Monitoring Research

Audio-Based Machine Learning Model for Traffic Congestion Detection

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

Can Synthetic Data Boost the Training of Deep Acoustic Vehicle Counting Networks?

Open Urban mmWave Radar and Camera Vehicle Classification Dataset for Traffic Monitoring

Improved Vehicle Sub-type Classification for Acoustic Traffic Monitoring

MVD:A Novel Methodology and Dataset for Acoustic Vehicle Type Classification

Deep Convolutional Neural Network for Roadway Incident Surveillance Using Audio Data

Intelligent Traffic Monitoring with Distributed Acoustic Sensing

Basics and Challenges in Acoustic Vehicle Sensing Using Sidewalk Microphones

DAS Vehicle Signal Extraction Using Machine Learning in Urban Traffic Monitoring

Improved convolutional neural network and spectrogram image feature for traffic sound event classification

Analysis of artificial intelligence methods for rail transport traffic noise detection

Artificial Intelligence for road quality assessment in smart cities: a machine learning approach to acoustic data analysis

Urban DAS Data Processing and Its Preliminary Application to City Traffic Monitoring

Robust Audio-Based Vehicle Counting in Low-to-Moderate Traffic Flow

Spatial Deep Deconvolution U-Net for Traffic Analyses with Distributed Acoustic Sensing

Automating Urban Soundscape Enhancements with AI: In-situ Assessment of Quality and Restorativeness in Traffic-Exposed Residential Areas

Self-Updating Vehicle Monitoring Framework Employing Distributed Acoustic Sensing towards Real-World Settings

Urban Traffic Noise Analysis Using UAV-Based Array of Microphones

TrafficCAM: A Versatile Dataset for Traffic Flow Segmentation