Abstract:With the development of deep learning techniques, the field of direction of arrival (DOA) estimation has also made significant progress. However, the accuracy of DOA estimation using end-to-end neural networks (NNs) heavily relies on the classification step of the networks, which necessitates the use of large and representative datasets. Additionally, conventional speech presence probability (SPP) estimation methods based on the ideal ratio mask (IRM) may misclassify time-frequency (T-F) bins dominated by non-speech and noise, which hinders the accurate extraction of directional information. To improve the robustness of existing DOA estimation algorithms, this paper proposes a DOA estimation method with T-F bin selection. In terms of output, instead of using IRM-based SPP, our proposed approach focuses on the a posteriori SPP, a deliberate choice aimed at circumventing potential confusion. For input optimization, we construct features that encompass spatial, temporal, and directional information concurrently, and these are coupled with a frequency bin-wise recurrent neural network (RNN) model to attain precise multi-channel SPP estimation. Subsequently, these SPP estimates are utilized to extract local information for DOA estimation. Moreover, the cascaded structure ensures that the model has the ability to complete out-of-label tasks, effectively reducing the dataset requirements by training only a subset of direction information to achieve omnidirectional DOA estimation. Besides, this contributes to the algorithm's ability to eliminate its reliance on the step size, setting it apart from other end-to-end methods. Simulation results validate that the proposed method achieves higher accuracy and lower error compared to both NN-based end-to-end approaches and traditional full-band approaches under various conditions of reverberation and signal-to-noise ratio.

Robust Direction-of-arrival Estimation for a Target Speaker Based on Multi-Task U-net Based Direct-Path Dominance Test

U-Net Based Direct-Path Dominance Test for Robust Direction-of-Arrival Estimation

Training Multi-Task Adversarial Network for Extracting Noise-Robust Speaker Embedding

Neural-Network-Based Direction-of-Arrival Estimation for Reverberant Speech - The Importance of Energetic, Temporal, and Spatial Information

Time-Frequency Bins Selection for Direction of Arrival Estimation Based on Speech Presence Probability Learning

Enhancing Direct‐path Relative Transfer Function Using Deep Neural Network for Robust Sound Source Localization

A Stacked Self-Attention Network for Two-Dimensional Direction-of-arrival Estimation in Hands-Free Speech Communication.

Multi-task single channel speech enhancement using speech presence probability as a secondary task training target

TB-NET: A Two-Branch Neural Network for Direction of Arrival Estimation under Model Imperfections

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

A high-resolution method for direction of arrival estimation based on an improved self-attention module

Progressive Multi-Target Network Based Speech Enhancement with Snr-Preselection for Robust Speaker Diarization

Target Active Speaker Detection with Audio-visual Cues

SDOA-Net: An Efficient Deep Learning-Based DOA Estimation Network for Imperfect Array

SDOA-Net: An Efficient Deep-Learning-Based DOA Estimation Network for Imperfect Array

Deep learning-based direction-of-arrival estimation for multiple speech sources using a small scale array

A3R-Net: adaptive attention aggregation residual network for sparse DOA estimation

Residual Neural Network for Direction‐of‐Arrival Estimation of Multiple Targets in Low SNR

Multi-Channel Automatic Speech Recognition Using Deep Complex Unet

LDnADMM-Net: A Denoising Unfolded Deep Neural Network for Direction-of-Arrival Estimations in A Low Signal-to-Noise Ratio

MDTCNet: Multi-Task Classifications Network and TCNN for Direction of Arrival Estimation