Abstract:Deep speaker embedding learning based on neural networks has become the predominant approach in speaker verification (SV) currently. In prior studies, researchers have investigated various network architectures. However, rare works pay attention to the question of how to achieve a better trade-off on model performance and computational complexity. In this paper, we focus on efficient architecture design for speaker verification. Firstly, we systematically study the effect of the network depth and width on performance and empirically discover that depth is more important than the width of networks for speaker verification task. Based on this observation, we propose a novel depth-first (DF) architecture design rule. By applying it to ResNet and ECAPA-TDNN, two new families of much deeper models, namely DF-ResNets and DF-ECAPAs, are constructed. In addition, to further boost the performance of small models in the low computation regime, two novel attentive feature fusion (AFF) schemes, including sequential AFF (S-AFF) and parallel AFF (P-AFF), are proposed to dynamically fuse features in a learnable way. Experimental results on the VoxCeleb dataset show that the newly proposed DF-ResNets and DF-ECAPAs can achieve a much better trade-off on performance and complexity than the original ResNet and ECAPA-TDNN. Moreover, small models can further obtain up to 40% relative improvement in EER by adopting AFF scheme with negligible computational cost. Finally, a comprehensive comparison with various other published SV systems illustrates that our proposed models achieve the best trade-off on performance and complexity in both low and high computation scenarios.

Improving Aggregation and Loss Function for Better Embedding Learning in End-to-End Speaker Verification System.

Learning Discriminative Speaker Embedding by Improving Aggregation Strategy and Loss Function for Speaker Verification

An Improved Deep Embedding Learning Method for Short Duration Speaker Verification

An Effective Deep Embedding Learning Architecture for Speaker Verification.

An Effective Deep Embedding Learning Method Based on Dense-Residual Networks for Speaker Verification

Deep Speaker Embedding Learning with Multi-level Pooling for Text-independent Speaker Verification

Wav2sv: End-to-end Speaker Embeddings Learning from Raw Waveforms Based on Metric Learning for Speaker Verification.

DeltaVLAD: an Efficient Optimization Algorithm to Discriminate Speaker Embedding for Text-Independent Speaker Verification

An Effective Speaker Recognition Method Based on Joint Identification and Verification Supervisions.

Deep Segment Attentive Embedding for Duration Robust Speaker Verification

Triplet-Center Loss Based Deep Embedding Learning Method for Speaker Verification

Multi-View Speaker Embedding Learning for Enhanced Stability and Discriminability.

Discriminative Neural Embedding Learning for Short-Duration Text-Independent Speaker Verification.

Acoustic Feature Shuffling Network for Text-independent Speaker Verification

Improving the Generalized Performance of Deep Embedding for Text-Independent Speaker Verification

A Dynamic Convolution Framework for Session-Independent Speaker Embedding Learning.

End-to-End Feature Learning for Text-Independent Speaker Verification

Margin Matters: Towards More Discriminative Deep Neural Network Embeddings for Speaker Recognition

Domain Robust Deep Embedding Learning for Speaker Recognition

Depth-First Neural Architecture with Attentive Feature Fusion for Efficient Speaker Verification.

Improving Embedding Extraction for Speaker Verification with Ladder Network