Abstract:Multi-source sound localization can find applications in many domains including auditory scene analysis, fault detection and diagnosis in manufacturing, augmented reality, etc. In far fields, 3D sound source localization is equivalent to finding the direction of arrival (DOA), namely, the azimuth and elevation angles of sound sources. Recent DOA estimation pipelines take multichannel audio inputs, extract spectral features from each channel and then feed them into a deep neural network. Unfortunately, the spectral features contain only the time-frequency information of the audio signals, while spatial information is only implicitly captured in the signals across different channels, which is highly dependent on the acoustic array geometry. To embed the spatial information of the sound source into the spectral feature representation, we propose a DSB-based spatial mapping method encode sound source location information. It can be combined with different feature extraction methods and machine learning models for DOA estimation. Furthermore, a redundancy removal procedure is proposed to accelerate DSB computation so that the pipeline can run in real-time on embedded GPUs, such as NVidia Jeston Nano. We conduct extensive experiments using two neural network models along with the DSB method on two datasets. The experiments demonstrate that the DOA errors can be effectively reduced using the DSB method. When combining DSB for feature extraction, the DOA errors are reduced by up to 19.24%. In addition, the feature extraction process is accelerated by up to 30.42% after the application of redundancy removal.

Two-dimensional detection based LRSS point recognition for multi-source DOA estimation

DOA estimation of multiple speech sources based on the single-source point detection using an FOA microphone

Multi-source DOA estimation in reverberant environments using potential single-source points enhancement

Passive Localization Based on Double-Correlation Function Using Sources of Opportunity

Joint DOA Estimation and Dereverberation Based on Multi-Channel Linear Prediction Filtering and Azimuth Sparsity

Passive Localization Based on Spectral Estimation Methods Using Sources of Opportunity

Feature Extracted Doa Estimation Algorithm Using Acoustic Array For Drone Surveillance

Closed-form multiple source direction-of-arrival estimator under reverberant environments

A Two-Step Approach for Narrowband Source Localization in Reverberant Rooms

Multiple-Speaker Localization Based on Direct-Path Features and Likelihood Maximization with Spatial Sparsity Regularization.

An iteratively reweighted steered response power approach to multisource localization using a distributed microphone network

A Two Microphone-Based Approach For Source Localization Of Multiple Speech Sources

Direction of Arrival Estimation of Multiple Acoustic Sources Using a Maximum Likelihood Method in the Spherical Harmonic Domain

Two microphone based direction of arrival estimation for multiple speech sources using spectral properties of speech

Joint Estimation of DOA and Range for Near-Field Sources in the Presence of Far-Field Sources and Alpha-Stable Noise

SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localization

Delay-and-Sum Beamforming Based Spatial Mapping for Multi-Source Sound Localization

Accurate Real-Time Estimation of 2-Dimensional Direction of Arrival using a 3-Microphone Array

A Deep Learning Method for DOA Estimation with Covariance Matrices in Reverberant Environments

Fast And Robust Doa Estimation Method Using Searching Space Pre-Estimation

Sound Localization Based on Acoustic Source Using Multiple Microphone Array in an Indoor Environment