Abstract:Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, Ahead of Print. In recent years, Sound Event Classification (SEC) is a remarkable field of computer audition research. The abilities to automatically capture and classify sound events are meaningful for expanding the auditory ability of autonomous vehicle in a complex driving environment. The Autonomous vehicles will encounter some special road conditions during driving, such as large truck occlusion, tunnels, and buildings that hinder radar detection. Therefore, the perception capabilities of on-board lidar, vision, and other sensors are impacted, resulting in a great threat to the safe driving of the car. At this time, auditory environment perception can provide auditory dimension information for the vehicle. However, with the increase of noise level, the SEC task of autonomous vehicle becomes seriously difficult. Traditional machine learning methods show weak robustness in the highly noisy environment. In this work, an autonomous vehicle Sound Event Classification (AVSEC) framework based on Spectrogram Image Features (SIFs) and Convolutional Neural Networks (CNN) algorithm is proposed to solve the SEC question. Further on, the ambulance, bus, civil defense siren, fire truck, screaming, etc. are taken as the research traffic sounds. Traffic Sound Datasets (TSD) are collected, augmented and customized. Then, directly connected channel (DCC) between convolutional blocks and Convolutional Block Attention Module (CBAM) are designed to optimize the neural network. Testing results show that the AVSEC system achieves an accuracy of 97.18%. Furthermore, the results of AVSEC and other machine learning methods are compared, which shows that the combination of SIFs and AVSEC-net provides better noise robustness and classification accuracy in AVSEC task. The sound classification algorithm designed in this paper, as an advanced auxiliary driving system for sound detection, can identify the sound types in the current traffic environment of the Autonomous vehicles, that is, the traffic scene category. The vehicle computer can remind the driver to pay attention to driving safety through the above sound types, so as to improve the safety of the driver and the vehicle.

A Modified Peripheral Auditory Model for Vehicle Classification

Improved Waveform‐feature‐based Vehicle Classification Using a Single‐point Magnetic Sensor

Improved Vehicle Sub-type Classification for Acoustic Traffic Monitoring

Vehicle Class Recognition Based on Vehicle's Sound Signal

Real-Time Vehicle Sound Detection System Based on Depthwise Separable Convolution Neural Network and Spectrogram Augmentation

Recognition of car horns based on principal component analysis of MEL frequency Cepstral coefficients and support vector machine

Binaural cepstrum coefficient and its application to ground target recognition

Automatic evaluation method for vehicle audio warning system using MFCC-polynomial hybrid feature

Vehicle Classification Based on Seismic Signatures Using Convolutional Neural Network

Vehicle Recognition in Acoustic Sensor Networks Via Sparse Representation.

Using Vehicle Interior Noise Classification for Monitoring Urban Rail Transit Infrastructure

Application of Artificial Neural Networks in Acoustic Classification of Vehicles

Abnormal noise monitoring of subway vehicles based on combined acoustic features

Studying critical frequency bands and channels for EEG-based automobile sound recognition with machine learning

A Deep Wavelet-Fourier Method for Monaural Vehicle Speed Estimation in Real-Life Settings

MVD:A Novel Methodology and Dataset for Acoustic Vehicle Type Classification

Classification of Non-Motorized Vehicle Based on Micro-Doppler Effect and Image Processing

Improved convolutional neural network and spectrogram image feature for traffic sound event classification

An Auditory-Based Feature Extraction Algorithm for Robust Speaker Identification under Mismatched Conditions

Exploring an Intelligent Classification Model for the Recognition of Automobile Sounds Based on EEG Physiological Signals

Auditory Model Based Speech Feature Extraction and Its Application to Speaker Identification