Abstract:Although many efforts have been made on decreasing the model complexity for speaker verification, it is still challenging to deploy speaker verification systems with satisfactory result on low-resource terminals. We design a transformation module that performs feature partition and fusion to implement lightweight speaker verification. The transformation module consists of multiple simple but effective operations, such as convolution, pooling, mean, concatenation, normalization, and element-wise summation. It works in a plug-and-play way, and can be easily implanted into a wide variety of models to reduce the model complexity while maintaining the model error. First, the input feature is split into several low-dimensional feature subsets for decreasing the model complexity. Then, each feature subset is updated by fusing it with the inter-feature-subsets correlational information to enhance its representational capability. Finally, the updated feature subsets are independently fed into the block (one or several layers) of the model for further processing. The features that are output from current block of the model are processed according to the steps above before they are fed into the next block of the model. Experimental data are selected from two public speech corpora (namely VoxCeleb1 and VoxCeleb2). Results show that implanting the transformation module into three models (namely AMCRN, ResNet34, and ECAPA-TDNN) for speaker verification slightly increases the model error and significantly decreases the model complexity. Our proposed method outperforms baseline methods on the whole in memory requirement and computational complexity with lower equal error rate. It also generalizes well across truncated segments with various lengths.

Speaker Verification by Removing Common Information

A New Speaker Verification Method with GlobalSpeaker Model and Likelihood Score Normalization

A fast speaker verification method with global speaker model

A Novel Text-Independent Speaker Verification Method Based on the Global Speaker Model

A novel speaker verification approach for certain noisy environment

Speaker Verification Based on Unsupervised Normalization and Factor Analysis

A New Method of Score Normalization for Text-Independent Speaker Verification

Score Normalization for Text-Independent Speaker Verification Systems

Model Session Variability in Speaker Verification

Speaker Verification Based on Factor Analysis and SVM

Very low complexity prompted speaker verification system based on HMM-modeling

Feature Extraction and Test Algorithm for Speaker Verification

Speaker verification system based on M-vector and support vector machine

Double Gauss Based Unsupervised Score Normalization in Speaker Verification

Clustering-Based Score Normalization for Speaker Verification

Study on a speaker recognition method with very low false acceptance

Lightweight Speaker Verification Using Transformation Module with Feature Partition and Fusion

Score Normalization-Based Speaking-Style Variation Robust Speaker Recognition

Improved i-vector Speaker Verification Based on WCCN and ZT-norm.

Simplified factor analysis in speaker verification

Text-independent speaker identification in noisy background