Abstract:Multi-source sound localization can find applications in many domains including auditory scene analysis, fault detection and diagnosis in manufacturing, augmented reality, etc. In far fields, 3D sound source localization is equivalent to finding the direction of arrival (DOA), namely, the azimuth and elevation angles of sound sources. Recent DOA estimation pipelines take multichannel audio inputs, extract spectral features from each channel and then feed them into a deep neural network. Unfortunately, the spectral features contain only the time-frequency information of the audio signals, while spatial information is only implicitly captured in the signals across different channels, which is highly dependent on the acoustic array geometry. To embed the spatial information of the sound source into the spectral feature representation, we propose a DSB-based spatial mapping method encode sound source location information. It can be combined with different feature extraction methods and machine learning models for DOA estimation. Furthermore, a redundancy removal procedure is proposed to accelerate DSB computation so that the pipeline can run in real-time on embedded GPUs, such as NVidia Jeston Nano. We conduct extensive experiments using two neural network models along with the DSB method on two datasets. The experiments demonstrate that the DOA errors can be effectively reduced using the DSB method. When combining DSB for feature extraction, the DOA errors are reduced by up to 19.24%. In addition, the feature extraction process is accelerated by up to 30.42% after the application of redundancy removal.

Infrasound Source Localization of Distributed Stations Using Sparse Bayesian Learning and Bayesian Information Fusion

A Bayesian Framework of Non-Synchronous Measurements at Coprime Positions for Sound Source Localization with High Resolution

Passive Source Localization Using Compressive Sensing

Matched-field source localization using sparsely-coded neural network and data-model mixed training

High Resolution Matched-Field Source Localization Based on Sparse-Reconstruction

A Fast and Robust Localization Method for Low-Frequency Acoustic Source: Variational Bayesian Inference Based on Nonsynchronous Array Measurements.

Sparse Bayesian learning based on spatio-temporal structure-aware for matched field processing

Joint Near Field Uplink Communication and Localization Using Message Passing-Based Sparse Bayesian Learning

Delay-and-Sum Beamforming Based Spatial Mapping for Multi-Source Sound Localization

Achieving the sparse acoustical holography via the sparse bayesian learning

Robust Sparse Bayesian Learning Source Localization in an Uncertain Shallow-Water Waveguide

A new hierarchical binaural sound source localization method based on Interaural Matching Filter

Multilevel B-Splines-Based Learning Approach for Sound Source Localization

Bi-Direction Interaural Matching Filter and Decision Weighting Fusion for Sound Source Localization in Noisy Environments.

Joint Source Localization and Sensor Position Refinement with Extra Inter-Sensor Information

Uncertainty Quantification for Infrasound Propagation in the Atmospheric Environment

Deep and CNN Fusion Method for Binaural Sound Source Localisation

Robust Localization of Signal Source Based on Information Fusion

Source Localization by Multidimensional Steered Response Power Mapping with Sparse Bayesian Learning

Joint DOA Estimation and Dereverberation Based on Multi-Channel Linear Prediction Filtering and Azimuth Sparsity

A Robust Source Localization Algorithm Applied to Acoustic Sensor Network