Abstract:Sound source localization (SSL) is an important technique for many audio processing systems, such as speech enhancement/recognition and human-robot interaction. Although many methods have been proposed for SSL, it still remains a challenging task to achieve accurate localization under adverse acoustic scenarios. In this paper, a novel binaural SSL method based on time-frequency convolutional neural network (TF-CNN) with multitask learning is proposed to simultaneously localize azimuth and elevation under unknown acoustic conditions. First, the interaural phase difference and interaural level difference are extracted from the received binaural signals, which are taken as the input of the proposed SSL neural network. Then, an SSL neural network is designed to map the interaural cues to sound direction, which consists of TF-CNN module and multitask neural network. The TF-CNN module learns and combines the time-frequency information of extracted interaural cues to generate the shared feature for multitask SSL. With the shared feature, a multitask neural network is designed to simultaneously estimate azimuth and elevation through multitask learning, which generates the posterior probability for candidate directions. Finally, the candidate direction with the highest probability is taken as the final direction estimation. The experiments based on public head-related transfer function (HRTF) database demonstrate that the proposed method achieves preferable localization performance compared with other popular methods. © 2013 IEEE.

Binaural Sound Source Localization Based on Weighted Template Matching

Binaural sound localization based on time-delay compensation and spatial grid matching

Probabilistic Binaural Multiple Sources Localization Based On Time-Delay Compensation Estimator And Clustering Analysis

A new hierarchical binaural sound source localization method based on Interaural Matching Filter

Binaural Sound Source Localization Based on Sub-band SNR Estimation

Bi-Direction Interaural Matching Filter and Decision Weighting Fusion for Sound Source Localization in Noisy Environments.

Binaural Cues Estimates Based on Interaural Matching Filter for Sound Source Localization.

Binaural Sound Localization Based on Reverberation Weighting and Generalized Parametric Mapping.

A Binaural Sound Source Localization Model Based on Time-Delay Compensation and Interaural Coherence

Binaural sound source localization based on generalized parametric model and two-layer matching strategy in complex environments

Sound source localization for robotics by binaural methods

Sound source localization based on binaural cross-correlation functions

A two-layer probabilistic model based on time-delay compensation for binaural sound localization

Sound Source Localization for HRI Using FOC-Based Time Difference Feature and Spatial Grid Matching.

Binaural Target Sound Source Localization Based on Time-frequency Units Selection

Multitask learning of time-frequency CNN for sound source localization

Sound Source Localization for Mobile Robot Based on Time Difference Feature and Space Grid Matching.

Sound Source Localization Method Based on Binaural Model Paper Title

Binaural sound source localization using a hybrid time and frequency domain model

Speech Enhancement Algorithm Based on Sound Source Localization and Scene Matching for Binaural Digital Hearing Aids

A Novel Sound Localization Method Based on Head Related Transfer Function