Abstract:Multi-source sound localization can find applications in many domains including auditory scene analysis, fault detection and diagnosis in manufacturing, augmented reality, etc. In far fields, 3D sound source localization is equivalent to finding the direction of arrival (DOA), namely, the azimuth and elevation angles of sound sources. Recent DOA estimation pipelines take multichannel audio inputs, extract spectral features from each channel and then feed them into a deep neural network. Unfortunately, the spectral features contain only the time-frequency information of the audio signals, while spatial information is only implicitly captured in the signals across different channels, which is highly dependent on the acoustic array geometry. To embed the spatial information of the sound source into the spectral feature representation, we propose a DSB-based spatial mapping method encode sound source location information. It can be combined with different feature extraction methods and machine learning models for DOA estimation. Furthermore, a redundancy removal procedure is proposed to accelerate DSB computation so that the pipeline can run in real-time on embedded GPUs, such as NVidia Jeston Nano. We conduct extensive experiments using two neural network models along with the DSB method on two datasets. The experiments demonstrate that the DOA errors can be effectively reduced using the DSB method. When combining DSB for feature extraction, the DOA errors are reduced by up to 19.24%. In addition, the feature extraction process is accelerated by up to 30.42% after the application of redundancy removal.

BeBeC-2014-02 SOUND SOURCE LOCALIZATION VIA ELASTIC NET REGULARIZATION

A Bayesian Framework of Non-Synchronous Measurements at Coprime Positions for Sound Source Localization with High Resolution

Efficient Localization of Low-Frequency Sound Source with Non-Synchronous Measurement at Coprime Positions by Alternating Direction Method of Multipliers.

A robust super-resolution approach with sparsity constraint for near-field wideband acoustic imaging

A Fast and Robust Localization Method for Low-Frequency Acoustic Source: Variational Bayesian Inference Based on Nonsynchronous Array Measurements.

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

Aeroacoustic Source Localization

Acoustic Array Systems : Paper ICA 2016-352 A sound source localization algorithm using microphone array with rigid body

An Improved Generalized Inverse Beamforming-Noise Source Localization Method Using Acoustic Vector Sensor Arrays

Sound Source Localization in Spherical Harmonics Domain Based on High-Order Ambisonics Signals Enhancement Neural Network

BeamLearning: An end-to-end deep learning approach for the angular localization of sound sources using raw multichannel acoustic pressure data

Application of Neural Network and Kalman Filtering in Sound Source Localization

High-Resolution Localization of Broadband Sound Sources in a Duct Using Out-Duct Array Measurements

An Intelligent Algorithm for Coherent Sound Source Localization Based on a Strong Tracking Filter

Delay-and-Sum Beamforming Based Spatial Mapping for Multi-Source Sound Localization

Joint DOA Estimation and Dereverberation Based on Multi-Channel Linear Prediction Filtering and Azimuth Sparsity

A Geometric Approach to Sound Source Localization from Time-Delay Estimates

Phased Microphone Array for Sound Source Localization with Deep Learning

Improvement of Sound Source Localization in a Finite Duct Using Beamforming Methods

DNN-based Sound Source Localization Method with Microphone Array

Deconvolution Algorithms of Phased Microphone Arrays for the Mapping of Acoustic Sources in an Airframe Test