Abstract:Human-robot interaction in natural settings requires filtering out the different sources of sounds from the environment. Such ability usually involves the use of microphone arrays to localize, track and separate sound sources online. Multi-microphone signal processing techniques can improve robustness to noise but the processing cost increases with the number of microphones used, limiting response time and widespread use on different types of mobile robots. Since sound source localization methods are the most expensive in terms of computing resources as they involve scanning a large 3D space, minimizing the amount of computations required would facilitate their implementation and use on robots. The robot's shape also brings constraints on the microphone array geometry and configurations. In addition, sound source localization methods usually return noisy features that need to be smoothed and filtered by tracking the sound sources. This paper presents a novel sound source localization method, called SRP-PHAT-HSDA, that scans space with coarse and fine resolution grids to reduce the number of memory lookups. A microphone directivity model is used to reduce the number of directions to scan and ignore non significant pairs of microphones. A configuration method is also introduced to automatically set parameters that are normally empirically tuned according to the shape of the microphone array. For sound source tracking, this paper presents a modified 3D Kalman (M3K) method capable of simultaneously tracking in 3D the directions of sound sources. Using a 16-microphone array and low cost hardware, results show that SRP-PHAT-HSDA and M3K perform at least as well as other sound source localization and tracking methods while using up to 4 and 30 times less computing resources respectively.

Robust 3D Localization and Tracking of Sound Sources Using Beamforming and Particle Filtering

Robust Localization and Tracking of Simultaneous Moving Sound Sources Using Beamforming and Particle Filtering

Real-Time Space 3D Acoustic Location Based on Monte Carlo Algorithm

High-Resolution Fast-Rotating Sound Localization Based on Modal Composition Beamforming and Bayesian Inversion

Lightweight and Optimized Sound Source Localization and Tracking Methods for Open and Closed Microphone Array Configurations

Joint Passive Detection and Tracking of Underwater Acoustic Target by Beamforming-Based Bernoulli Filter with Multiple Arrays.

3D Localization of a Sound Source Using Mobile Microphone Arrays Referenced by SLAM

Online Localization and Tracking of Multiple Moving Speakers in Reverberant Environments

Towards Robust Multiple Blind Source Localization Using Source Separation and Beamforming

Bi-Channel Sound Source Localization System for Speaker Detection

Particle Filter for Acoustic Source Localization

Real-time Sound source localization for a mobile robot based on the guided spectral-temporal position method

A High-Resolution and Low-Frequency Acoustic Beamforming Based on Bayesian Inference and Non-Synchronous Measurements

BeamLearning: An end-to-end deep learning approach for the angular localization of sound sources using raw multichannel acoustic pressure data

Auditory System for a Mobile Robot

A Speech Enhancement System Based on Real-time Sound Source Localization and Super-directional Fixed Beamforming

Real-time Sound Source Localization Using Hybrid Framework

Robust Sound Source Tracking Using SRP-PHAT and 3D Convolutional Neural Networks

Multiple-Speaker Localization Based on Direct-Path Features and Likelihood Maximization with Spatial Sparsity Regularization.

Binaural Sound Source Localization Based On Steered Beamformer With Spherical Scatterer

Robust Sound Source Localization considering Similarity of Back-Propagation Signals