Abstract:Sound source localization (SSL) is an important technique for many audio processing systems, such as speech enhancement/recognition and human-robot interaction. Although many methods have been proposed for SSL, it still remains a challenging task to achieve accurate localization under adverse acoustic scenarios. In this paper, a novel binaural SSL method based on time-frequency convolutional neural network (TF-CNN) with multitask learning is proposed to simultaneously localize azimuth and elevation under unknown acoustic conditions. First, the interaural phase difference and interaural level difference are extracted from the received binaural signals, which are taken as the input of the proposed SSL neural network. Then, an SSL neural network is designed to map the interaural cues to sound direction, which consists of TF-CNN module and multitask neural network. The TF-CNN module learns and combines the time-frequency information of extracted interaural cues to generate the shared feature for multitask SSL. With the shared feature, a multitask neural network is designed to simultaneously estimate azimuth and elevation through multitask learning, which generates the posterior probability for candidate directions. Finally, the candidate direction with the highest probability is taken as the final direction estimation. The experiments based on public head-related transfer function (HRTF) database demonstrate that the proposed method achieves preferable localization performance compared with other popular methods. © 2013 IEEE.

Binaural Sound Source Localization Based on Sub-band SNR Estimation

Binaural sound localization based on time-delay compensation and spatial grid matching

A Bayesian Framework of Non-Synchronous Measurements at Coprime Positions for Sound Source Localization with High Resolution

Binaural Target Sound Source Localization Based on Time-frequency Units Selection

Probabilistic Binaural Multiple Sources Localization Based On Time-Delay Compensation Estimator And Clustering Analysis

Deep Learning for Binaural Sound Source Localization with Low Signal-to-noise Ratio

Sound source localization based on binaural cross-correlation functions

Binaural Sound Source Localization Based on Weighted Template Matching

Binaural Sound Localization Based on Reverberation Weighting and Generalized Parametric Mapping.

Full-Sphere Binaural Sound Source Localization Using Multi-task Neural Network

Multitask learning of time-frequency CNN for sound source localization

A Binaural Sound Source Localization Model Based on Time-Delay Compensation and Interaural Coherence

RESEARCH ON SOUND SOURCE LOCALISATION ALGORITHM BASED ON MICROPHONE ARRAY

Binaural Sound Source Localization based on Neural Networks in Mismatched HRTF Condition.

Binaural sound source localization using a hybrid time and frequency domain model

Binaural Sound Source Localization Based On Steered Beamformer With Spherical Scatterer

Adaptive high-precision sound source localization at low frequencies based on convolutional neural network

Multi-Tone Phase Coding of Interaural Time Difference for Sound Source Localization with Spiking Neural Networks

A new hierarchical binaural sound source localization method based on Interaural Matching Filter

Multiple Sound Sources Localization by Using Statistical Source Component Equalization.

An Environment-Adaptation Based Binaural Localization Method