Abstract:The speaker encoder is an important front-end module that explores discriminative speaker features for many speech applications requiring speaker information. Current speaker encoders aggregate multi-scale features from utterances using multi-branch network architectures. However, naively adding many branches through a fully convolutional operation cannot efficiently improve its capability to capture multi-scale features due to the problem of rapid increase of model parameters and computational complexity. Therefore, in current network architectures, only a few branches corresponding to a limited number of temporal scales are designed for capturing speaker features. To address this problem, this paper proposes an effective temporal multi-scale (TMS) model where multi-scale branches could be efficiently designed in a speaker encoder while negligibly increasing computational costs. The TMS model is based on a time-delay neural network (TDNN), where the network architecture is separated into channel-modeling and temporal multi-branch modeling operators. In the TMS model, adding temporal multi-scale elements in the temporal multi-branch operator only slightly increases the model's parameters, thus saving more of the computational budget to add branches with large temporal scales. After model training, we further develop a systemic re-parameterization method to convert the multi-branch network topology into a single-path-based topology to increase the inference speed.We conducted automatic speaker verification (ASV) experiments under in-domain (VoxCeleb) and out-of-domain (CNCeleb) conditions to investigate the proposed TMS model's performance.Experimental results show that the TMS-method-based model outperformed state-of-the-art ASV models (e.g., ECAPA-TDNN) and improved robustness. Moreover, the proposed model achieved a 29%–46% increase in the inference speed compared to ECAPA-TDNN.

Improved multitaper PNCC feature for robust speaker verification

A perceptually-motivated low-complexity instantaneous linear channel normalization technique applied to speaker verification

Improving Speaker Verification Performance Against Long-Term Speaker Variability

CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking

Cam: Context-Aware Masking for Robust Speaker Verification.

Neighborhood Attention Transformer with Progressive Channel Fusion for Speaker Verification

PCF: ECAPA-TDNN with Progressive Channel Fusion for Speaker Verification

A novel hybrid feature method based on Caelen auditory model and gammatone filterbank for robust speaker recognition under noisy environment and speech coding distortion

Modified MFCCs for Robust Speaker Recognition

Introducing Phonetic Information to Speaker Embedding for Speaker Verification

Weighted Cluster-Range Loss and Criticality-Enhancement Loss for Speaker Recognition

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

TMS: Temporal multi-scale in time-delay neural network for speaker verification

Noise-robustness of speaker verification based on the perceptual log area ratio

ELM speaker identification for limited dataset using multitaper based MFCC and PNCC features with fusion score

P-vectors: A Parallel-Coupled TDNN/Transformer Network for Speaker Verification

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

Variant Time-Frequency Cepstral Features for Speaker Recognition

Speaker Verification Using Simple Temporal Features and Pitch Synchronous Cepstral Coefficients

Bionic Cepstral coefficients (BCC): A new auditory feature extraction to noise-robust speaker identification

Single Channel Far Field Feature Enhancement For Speaker Verification In The Wild