Abstract:This paper addresses the problem of multiple-speaker localization in noisy and reverberant environments, using binaural recordings of an acoustic scene. A complex-valued Gaussian mixture model (CGMM) is adopted, whose components correspond to all the possible candidate source locations defined on a grid. After optimizing the CGMM-based objective function, given an observed set of complex-valued binaural features, both the number of sources and their locations are estimated by selecting the CGMM components with the largest weights. An entropy-based penalty term is added to the likelihood to impose sparsity over the set of CGMM component weights. This favors a small number of detected speakers with respect to the large number of initial candidate source locations. In addition, the direct-path relative transfer function (DP-RTF) is used to build robust binaural features. The DP-RTF, recently proposed for single-source localization, encodes interchannel information corresponding to the direct path of sound propagation and is thus robust to reverberations. In this paper, we extend the DP-RTF estimation to the case of multiple sources. In the short-time Fourier transform domain, a consistency test is proposed to check whether a set of consecutive frames is associated with the same source or not. Reliable DP-RTF features are selected from the frames that pass the consistency test to be used for source localization. Experiments carried out using both simulation data and real data recorded with a robotic head confirm the efficiency of the proposed multisource localization method.

Sparse Bayesian Learning for Multiple Sources Localization with Unknown Propagation Parameters

Sparse Bayesian Inference Based Direct Localization for Massive MIMO.

Channel Estimation and Localization for Mmwave Systems: A Sparse Bayesian Learning Approach

Matched-field source localization using sparsely-coded neural network and data-model mixed training

Passive Source Localization Using Compressive Sensing

Passive Localization Based on Double-Correlation Function Using Sources of Opportunity

Matched-field source localization under multi-coherent modal group model via covariance matrix matching

Source Localization by Multidimensional Steered Response Power Mapping with Sparse Bayesian Learning

Passive Localization Based on Spectral Estimation Methods Using Sources of Opportunity

RSS-Based Multiple Co-Channel Sources Localization With Unknown Shadow Fading and Transmitted Power

Multisource Sparse Inversion Localization with Long-Distance Mobile Sensors

Robust Sparse Bayesian Learning Source Localization in an Uncertain Shallow-Water Waveguide

Multiple Sources Localization with Sparse Recovery under Log-normal Shadow Fading

On Sparse Bayesian Spreading Function Estimation Based Iterative Detection in Multiple-Input Multiple-Output Underwater Acoustic Communications

Deep Learning-Based Multiple Co-Channel Sources Localization Using Bernoulli Heatmap

Passive Source Localization from Array Covariance Matrices Via Joint Sparse Representations.

Estimating the direction of arrival of spatially spread sources using block-sparse Bayesian learning with an extended dictionary

Multiple-Speaker Localization Based on Direct-Path Features and Likelihood Maximization with Spatial Sparsity Regularization.

Joint Near Field Uplink Communication and Localization Using Message Passing-Based Sparse Bayesian Learning

Source Localization by Frequency Measurements in Unknown Signal Propagation Speed Environments

A Spaceborne Passive Localization Algorithm Based on MSD-HOUGH for Multiple Signal Sources