Abstract:In recent years, several supervised learning-based approaches have been proposed for estimating the direction of arrival (DOA) of a single talker in noisy and reverberant environments. In the absence of auxiliary information, such as a voice activity detector (VAD), the estimated DOA may be erroneous due to speech pauses or noise dominance. In this paper, we consider a speech-aware DOA estimation system for binaural hearing aids, which does not require a separate VAD. This system utilizes a combination of spatial features with an auditory-inspired periodicity feature called periodicity degree (PD) as input features of a convolutional neural network (CNN). Using speech and non-speech signals during the training, the CNN can capture the harmonic structure encoded in the PD features, thereby distinguishing speech from non-speech portions and simultaneously mapping spatial features to sound source DOA upon speech detection. To investigate the benefit of using PD features for speech-aware DOA estimation, we evaluated the performance of speech-aware systems that utilized either broadband or narrowband feature combinations compared to baseline systems. We propose to use a novel narrowband feature combination consisting of the narrowband cross-power spectrum (CPS) as the spatial feature and a new subband-averaged representation of PD features. The broadband feature combination consisted of the generalized cross-correlation with phase transform (GCC-PHAT) and the broadband PD features. The baseline systems considered in this work consisted of a CNN that exploits only a spatial feature, cascaded with a VAD. Evaluations in reverberant environments with different background noises for both static and dynamic single-talker scenarios demonstrate that incorporating the PD feature in conjunction with any type of spatial feature provides an advantage for binaural DOA estimation in terms of accuracy and angular error.

Neural-Network-Based Direction-of-Arrival Estimation for Reverberant Speech - The Importance of Energetic, Temporal, and Spatial Information

Speaker localization using direct path dominance test based on sound field directivity

Time-Frequency Bins Selection for Direction of Arrival Estimation Based on Speech Presence Probability Learning

Enhancing Direct‐path Relative Transfer Function Using Deep Neural Network for Robust Sound Source Localization

U-Net Based Direct-Path Dominance Test for Robust Direction-of-Arrival Estimation

Direction of Arrival Estimation Based on Reverberation Weighting and Noise Error Estimator.

Deep learning-based direction-of-arrival estimation for multiple speech sources using a small scale array

Speech-Aware Binaural DOA Estimation Utilizing Periodicity and Spatial Features in Convolutional Neural Networks

All Neural Low-latency Directional Speech Extraction

Improved direction of arrival estimations with a wearable microphone array for dynamic environments by reliability weighting

A Deep Learning Method for DOA Estimation with Covariance Matrices in Reverberant Environments

Accurate Real-Time Estimation of 2-Dimensional Direction of Arrival using a 3-Microphone Array

A high-resolution method for direction of arrival estimation based on an improved self-attention module

Learning Deep Direct-Path Relative Transfer Function for Binaural Sound Source Localization

DOA Estimation by DNN-based Denoising and Dereverberation from Sound Intensity Vector

Direct source and early reflections localization using deep deconvolution network under reverberant environment

Deep learning approach for high-resolution DOA estimation

SubspaceNet: Deep Learning-Aided Subspace Methods for DoA Estimation

SDOA-Net: An Efficient Deep-Learning-Based DOA Estimation Network for Imperfect Array

Configurable DOA Estimation using Incremental Learning

Closed-form multiple source direction-of-arrival estimator under reverberant environments