Abstract:Although many efforts have been made on decreasing the model complexity for speaker verification, it is still challenging to deploy speaker verification systems with satisfactory result on low-resource terminals. We design a transformation module that performs feature partition and fusion to implement lightweight speaker verification. The transformation module consists of multiple simple but effective operations, such as convolution, pooling, mean, concatenation, normalization, and element-wise summation. It works in a plug-and-play way, and can be easily implanted into a wide variety of models to reduce the model complexity while maintaining the model error. First, the input feature is split into several low-dimensional feature subsets for decreasing the model complexity. Then, each feature subset is updated by fusing it with the inter-feature-subsets correlational information to enhance its representational capability. Finally, the updated feature subsets are independently fed into the block (one or several layers) of the model for further processing. The features that are output from current block of the model are processed according to the steps above before they are fed into the next block of the model. Experimental data are selected from two public speech corpora (namely VoxCeleb1 and VoxCeleb2). Results show that implanting the transformation module into three models (namely AMCRN, ResNet34, and ECAPA-TDNN) for speaker verification slightly increases the model error and significantly decreases the model complexity. Our proposed method outperforms baseline methods on the whole in memory requirement and computational complexity with lower equal error rate. It also generalizes well across truncated segments with various lengths.

On the importance of different frequency bins for speaker verification

Toward Pitch-Insensitive Speaker Verification Via Soundfield

Ghost-in-Wave: How Speaker-Irrelative Features Interfere DeepFake Voice Detectors

Improving Speaker Verification Performance Against Long-Term Speaker Variability

Hierarchically Attending Time-Frequency and Channel Features for Improving Speaker Verification

Research on generalization property of time-varying Fbank-weighted MFCC for i-vector based speaker verification

Depth-First Neural Architecture with Attentive Feature Fusion for Efficient Speaker Verification.

Distance-based Weight Transfer from Near-field to Far-field Speaker Verification

Attentive Feature Fusion for Robust Speaker Verification

Application of variable frame length and frame rate in speaker verification system

VOT: Revolutionizing Speaker Verification with Memory and Attention Mechanisms

ERes2NetV2: Boosting Short-Duration Speaker Verification Performance with Computational Efficiency

DeltaVLAD: an Efficient Optimization Algorithm to Discriminate Speaker Embedding for Text-Independent Speaker Verification

Adaptive Large Margin Fine-Tuning for Robust Speaker Verification

DF-ResNet: Boosting Speaker Verification Performance with Depth-First Design

Lightweight Speaker Verification Using Transformation Module with Feature Partition and Fusion

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

FDN: Finite Difference Network with Hierarchical Convolutional Features for Text-independent Speaker Verification

Learning Discriminative Speaker Embedding by Improving Aggregation Strategy and Loss Function for Speaker Verification

Improving Aggregation and Loss Function for Better Embedding Learning in End-to-End Speaker Verification System.

Wav2sv: End-to-end Speaker Embeddings Learning from Raw Waveforms Based on Metric Learning for Speaker Verification.