Abstract:Although many efforts have been made on decreasing the model complexity for speaker verification, it is still challenging to deploy speaker verification systems with satisfactory result on low-resource terminals. We design a transformation module that performs feature partition and fusion to implement lightweight speaker verification. The transformation module consists of multiple simple but effective operations, such as convolution, pooling, mean, concatenation, normalization, and element-wise summation. It works in a plug-and-play way, and can be easily implanted into a wide variety of models to reduce the model complexity while maintaining the model error. First, the input feature is split into several low-dimensional feature subsets for decreasing the model complexity. Then, each feature subset is updated by fusing it with the inter-feature-subsets correlational information to enhance its representational capability. Finally, the updated feature subsets are independently fed into the block (one or several layers) of the model for further processing. The features that are output from current block of the model are processed according to the steps above before they are fed into the next block of the model. Experimental data are selected from two public speech corpora (namely VoxCeleb1 and VoxCeleb2). Results show that implanting the transformation module into three models (namely AMCRN, ResNet34, and ECAPA-TDNN) for speaker verification slightly increases the model error and significantly decreases the model complexity. Our proposed method outperforms baseline methods on the whole in memory requirement and computational complexity with lower equal error rate. It also generalizes well across truncated segments with various lengths.

Cross-Lingual Speaker Verification Based On Linear Transform

Cross-lingual Speaker Verification with Deep Feature Learning.

Feature Transformation for Speaker Verification under Speaking Rate Mismatch Condition

VarASV: Enabling Pitch-variable Automatic Speaker Verification Via Multi-task Learning

Emotional speaker verification with linear adaptation

AudioVSR: Enhancing Video Speech Recognition with Audio Data

Toward Pitch-Insensitive Speaker Verification Via Soundfield

Improving Speaker Verification Performance Against Long-Term Speaker Variability

Introducing Multilingual Phonetic Information to Speaker Embedding for Speaker Verification

Lightweight Speaker Verification Using Transformation Module with Feature Partition and Fusion

A CMLLR supervector kernel for SVM language recognition.

Tackling the Score Shift in Cross-Lingual Speaker Verification by Exploiting Language Information

Emotional adaptive training for speaker verification

Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation

Building Bilingual and Code-Switched Voice Conversion with Limited Training Data Using Embedding Consistency Loss

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

Language-aware PLDA for multilingual speaker recognition

Cross-lingual Text-independent Speaker Verification using Unsupervised Adversarial Discriminative Domain Adaptation

A framework of text-dependent speaker verification for chinese numerical string corpus

Mandarin Electrolaryngeal Speech Voice Conversion using Cross-domain Features