Abstract:Conventional time-delay neural networks (TDNNs) struggle to handle long-range context, their ability to represent speaker information is therefore limited in long utterances. Existing solutions either depend on increasing model complexity or try to balance between local features and global context to address this issue. To effectively leverage the long-term dependencies of audio signals and constrain model complexity, we introduce a novel module called Global-aware Filter layer (GF layer) in this work, which employs a set of learnable transform-domain filters between a 1D discrete Fourier transform and its inverse transform to capture global context. Additionally, we develop a dynamic filtering strategy and a sparse regularization method to enhance the performance of the GF layer and prevent overfitting. Based on the GF layer, we present a dual-stream TDNN architecture called DS-TDNN for automatic speaker verification (ASV), which utilizes two unique branches to extract both local and global features in parallel and employs an efficient strategy to fuse different-scale information. Experiments on the Voxceleb and SITW databases demonstrate that the DS-TDNN achieves a relative improvement of 10\% together with a relative decline of 20\% in computational cost over the ECAPA-TDNN in speaker verification task. This improvement will become more evident as the utterance's duration grows. Furthermore, the DS-TDNN also beats popular deep residual models and attention-based systems on utterances of arbitrary length.

Novel Method for Speaker Feature Extraction Using Deep Neural Network

End-to-End Feature Learning for Text-Independent Speaker Verification

Deep Speaker Feature Learning for Text-independent Speaker Verification

Analysis of Deep Generative Model Impact on Feature Extraction and Dimension Reduction for Short Utterance Text-Independent Speaker Verification

Learning Deep Embedding with Acoustic and Phoneme Features for Speaker Recognition in FM Broadcasting

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

Improving Deep Neural Networks Based Speaker Verification Using Unlabeled Data

Deep Speaker Vectors for Semi Text-independent Speaker Verification

Research on Voiceprint Recognition Technology Based on Deep Neural Network

Self-Attention Networks for Text-Independent Speaker Verification

Factor analysis based speaker verification using ASR

A Unified Deep Neural Network for Speaker and Language Recognition

A novel speech feature fusion algorithm for text-independent speaker recognition

Cross-lingual Speaker Verification with Deep Feature Learning.

FDN: Finite Difference Network with Hierarchical Convolutional Features for Text-independent Speaker Verification

DS-TDNN: Dual-stream Time-delay Neural Network with Global-aware Filter for Speaker Verification

A Neural-Network-Based Approach to Identifying Speakers in Novels

An Energy-Efficient Binarized Neural Network Using Analog-Intensive Feature Extraction for Keyword and Speaker Verification Wakeup.

Self-Adaptive Soft Voice Activity Detection using Deep Neural Networks for Robust Speaker Verification

Speech Separation Based on Signal-Noise-dependent Deep Neural Networks for Robust Speech Recognition

Full-Info Training for Deep Speaker Feature Learning