Abstract:The convolutional neural network (CNN) based approaches have shown great success for speaker verification (SV) tasks, where modeling long temporal context and reducing information loss of speaker characteristics are two important challenges significantly affecting the verification performance. Previous works have introduced dilated convolution and multi-scale aggregation methods to address above challenges. However, such methods are also hard to make full use of some valuable information, which make it difficult to substantially improve the verification performance. To address above issues, we construct a novel CNN-based architecture for SV, called RSKNet-MTSP, where a residual selective kernel block (RSKBlock) and a multiple time-scale statistics pooling (MTSP) module are first proposed. The RSKNet-MTSP can capture both long temporal context and neighbouring information, and gather more speaker-discriminative information from multi-scale features. In order to design a portable model for real applications with limited resources, we then present a lightweight version of RSKNet-MTSP, namely RSKNet-MTSP-L, which employs a combination technique associating the depthwise separable convolutions with low-rank factorization of weight matrices. Extensive experiments are conducted on two public SV datasets, VoxCeleb and Speaker in the Wild (SITW). The results demonstrate that 1) RSKNet-MTSP outperforms the state-of-the-art deep embedding architectures by at least 9%-26% in all test sets. 2) RSKNet-MTSP-L achieves competitive performance compared with baseline models with 17%-39% less network parameters. The ablation experiments further illustrate that our proposed approaches can achieve substantial improvement over prior methods.

Depth-First Neural Architecture with Attentive Feature Fusion for Efficient Speaker Verification.

DF-ResNet: Boosting Speaker Verification Performance with Depth-First Design

Attentive Feature Fusion for Robust Speaker Verification

An Effective Deep Embedding Learning Architecture for Speaker Verification.

ECAPA++: Fine-grained Deep Embedding Learning for TDNN Based Speaker Verification

PCF: ECAPA-TDNN with Progressive Channel Fusion for Speaker Verification

End-to-End Feature Learning for Text-Independent Speaker Verification

Dilated Residual Networks with Multi-Level Attention for Speaker Verification

An Effective Deep Embedding Learning Method Based on Dense-Residual Networks for Speaker Verification

Deep Embedding Learning for Text-Dependent Speaker Verification.

SpeechNAS: Towards Better Trade-off Between Latency and Accuracy for Large-Scale Speaker Verification

ERes2NetV2: Boosting Short-Duration Speaker Verification Performance with Computational Efficiency

ResNeXt and Res2Net Structures for Speaker Verification

RSKNet-MTSP: Effective and Portable Deep Architecture for Speaker Verification

Speaker Verification With Deep Features

Learning Discriminative Speaker Embedding by Improving Aggregation Strategy and Loss Function for Speaker Verification

FDN: Finite Difference Network with Hierarchical Convolutional Features for Text-independent Speaker Verification

Deep Speaker Embedding Learning with Multi-level Pooling for Text-independent Speaker Verification

A Unified Deep Learning Framework for Short-Duration Speaker Verification in Adverse Environments

Deep Speaker Embedding with Multi-Part Information Aggregation in Frequency-Time Domain for ASV