Abstract:With the development of deep learning techniques, the field of direction of arrival (DOA) estimation has also made significant progress. However, the accuracy of DOA estimation using end-to-end neural networks (NNs) heavily relies on the classification step of the networks, which necessitates the use of large and representative datasets. Additionally, conventional speech presence probability (SPP) estimation methods based on the ideal ratio mask (IRM) may misclassify time-frequency (T-F) bins dominated by non-speech and noise, which hinders the accurate extraction of directional information. To improve the robustness of existing DOA estimation algorithms, this paper proposes a DOA estimation method with T-F bin selection. In terms of output, instead of using IRM-based SPP, our proposed approach focuses on the a posteriori SPP, a deliberate choice aimed at circumventing potential confusion. For input optimization, we construct features that encompass spatial, temporal, and directional information concurrently, and these are coupled with a frequency bin-wise recurrent neural network (RNN) model to attain precise multi-channel SPP estimation. Subsequently, these SPP estimates are utilized to extract local information for DOA estimation. Moreover, the cascaded structure ensures that the model has the ability to complete out-of-label tasks, effectively reducing the dataset requirements by training only a subset of direction information to achieve omnidirectional DOA estimation. Besides, this contributes to the algorithm's ability to eliminate its reliance on the step size, setting it apart from other end-to-end methods. Simulation results validate that the proposed method achieves higher accuracy and lower error compared to both NN-based end-to-end approaches and traditional full-band approaches under various conditions of reverberation and signal-to-noise ratio.

U-Net Based Direct-Path Dominance Test for Robust Direction-of-Arrival Estimation

Robust Direction-of-arrival Estimation for a Target Speaker Based on Multi-Task U-net Based Direct-Path Dominance Test

Neural-Network-Based Direction-of-Arrival Estimation for Reverberant Speech - The Importance of Energetic, Temporal, and Spatial Information

Enhancing Direct‐path Relative Transfer Function Using Deep Neural Network for Robust Sound Source Localization

Time-Frequency Bins Selection for Direction of Arrival Estimation Based on Speech Presence Probability Learning

IPDnet: A Universal Direct-Path IPD Estimation Network for Sound Source Localization

Speaker localization using direct path dominance test based on sound field directivity

SDOA-Net: An Efficient Deep Learning-Based DOA Estimation Network for Imperfect Array

SDOA-Net: An Efficient Deep-Learning-Based DOA Estimation Network for Imperfect Array

Learning Deep Direct-Path Relative Transfer Function for Binaural Sound Source Localization

TB-NET: A Two-Branch Neural Network for Direction of Arrival Estimation under Model Imperfections

LDnADMM-Net: A Denoising Unfolded Deep Neural Network for Direction-of-Arrival Estimations in A Low Signal-to-Noise Ratio

A high-resolution method for direction of arrival estimation based on an improved self-attention module

All Neural Low-latency Directional Speech Extraction

MDTCNet: Multi-Task Classifications Network and TCNN for Direction of Arrival Estimation

A3R-Net: adaptive attention aggregation residual network for sparse DOA estimation

Deep Convolutional Network-Assisted Multiple Direction-of-Arrival Estimation

SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localization

Deep learning-based direction-of-arrival estimation for multiple speech sources using a small scale array

SubspaceNet: Deep Learning-Aided Subspace Methods for DoA Estimation

Deep Neural Network-Based Bottleneck Feature and Denoising Autoencoder-Based Dereverberation for Distant-Talking Speaker Identification.