Abstract:Multi-source sound localization can find applications in many domains including auditory scene analysis, fault detection and diagnosis in manufacturing, augmented reality, etc. In far fields, 3D sound source localization is equivalent to finding the direction of arrival (DOA), namely, the azimuth and elevation angles of sound sources. Recent DOA estimation pipelines take multichannel audio inputs, extract spectral features from each channel and then feed them into a deep neural network. Unfortunately, the spectral features contain only the time-frequency information of the audio signals, while spatial information is only implicitly captured in the signals across different channels, which is highly dependent on the acoustic array geometry. To embed the spatial information of the sound source into the spectral feature representation, we propose a DSB-based spatial mapping method encode sound source location information. It can be combined with different feature extraction methods and machine learning models for DOA estimation. Furthermore, a redundancy removal procedure is proposed to accelerate DSB computation so that the pipeline can run in real-time on embedded GPUs, such as NVidia Jeston Nano. We conduct extensive experiments using two neural network models along with the DSB method on two datasets. The experiments demonstrate that the DOA errors can be effectively reduced using the DSB method. When combining DSB for feature extraction, the DOA errors are reduced by up to 19.24%. In addition, the feature extraction process is accelerated by up to 30.42% after the application of redundancy removal.

A Fast Estimation Method for 3-D Acoustic Source Localization

Three-dimensional Acoustic Localization Algorithm Based on Coordinate Conversion

Real-Time Space 3D Acoustic Location Based on Monte Carlo Algorithm

Efficient Localization of Low-Frequency Sound Source with Non-Synchronous Measurement at Coprime Positions by Alternating Direction Method of Multipliers.

A Real-Time 3-D Underwater Acoustical Imaging System

Three Dimensional Passive Localization Based on Distributed Buoy Array for Underwater Moving Sound Source with High Speed

Passive Localization Based on Spectral Estimation Methods Using Sources of Opportunity

A Fast and Robust Localization Method for Low-Frequency Acoustic Source: Variational Bayesian Inference Based on Nonsynchronous Array Measurements.

Fast And Robust Doa Estimation Method Using Searching Space Pre-Estimation

Research On The Fast Direction Estimation And Display Method Of Far-Field Signal

A Two-step 2-D DOA Estimation Algorithm Via Underwater Acoustic Vector-Sensor Array

3-D Source Localization based on 1-D AOA Measurements: Low-Complexity and Effective Estimator

An Underdetermined Wideband 2-D DOA Estimation Algorithm Via Acoustic Vector-Sensor Coprime Array

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

A Fast Direct Source Localization Approach for Acoustic Sensor Array

Fast source location method using anti-reverberant searching space pre-estimation

Three-dimensional sound source localization system based on fiber optic sensor array with an adaptive algorithm

3-D Near-Field Source Localization Using a Spatially Spread Acoustic Vector Sensor

Accurate Real-Time Estimation of 2-Dimensional Direction of Arrival using a 3-Microphone Array

Sound Source Detection Using A Fast Moving Time Difference Of Arrival Method

Delay-and-Sum Beamforming Based Spatial Mapping for Multi-Source Sound Localization