Abstract:Text-independent speaker recognition using short utterances is a highly challenging task due to the large variation and content mismatch between short utterances. I-vector and probabilistic linear discriminant analysis (PLDA) based systems have become the standard in speaker verification applications, but they are less effective with short utterances. In this paper, we first compare two state-of-the-art universal background model (UBM) training methods for i-vector modeling using full-length and short utterance evaluation tasks. The two methods are Gaussian mixture model (GMM) based (denoted I-vector_GMM) and deep neural network (DNN) based (denoted as I-vector_DNN) methods. The results indicate that the I-vector_DNN system outperforms the I-vector_GMM system under various durations (from full length to 5 s). However, the performances of both systems degrade significantly as the duration of the utterances decreases. To address this issue, we propose two novel nonlinear mapping methods which train DNN models to map the i-vectors extracted from short utterances to their corresponding long-utterance i-vectors. The mapped i-vector can restore missing information and reduce the variance of the original short-utterance i-vectors. The proposed methods both model the joint representation of short and long utterance i-vectors: the first method trains an autoencoder first using concatenated short and long utterance i-vectors and then uses the pre-trained weights to initialize a supervised regression model from the short to long version; the second method jointly trains the supervised regression model with an autoencoder reconstructing the short utterance i-vector itself. Experimental results using the NIST SRE 2010 dataset show that both methods provide significant improvement and result in a 24.51% relative improvement in Equal Error Rates (EERs) from a baseline system. In order to learn a better joint representation, we further investigate the effect of a deep encoder with residual blocks, and the results indicate that the residual network can further improve the EERs of a baseline system by up to 26.47%. Moreover, in order to improve the short i-vector mapping to its long version, an additional vector, which represents the average value of phoneme posteriors across frames, is also added to the input, and results in a 28.43% improvement. When further testing the best-validated models of SRE10 on the Speaker In The Wild (SITW) dataset, the methods result in a 23.12% improvement on arbitrary-duration (1–5 s) short-utterance conditions.

On The Complementary Role Of Dnn Multi-Level Enhancement For Noisy Robust Speaker Recognition In An I-Vector Framework

Noise Robust Speaker Recognition Based on Adaptive Frame Weighting in GMM for i-Vector Extraction.

Weighted Cluster-Range Loss and Criticality-Enhancement Loss for Speaker Recognition

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

Deep neural networks based speaker modeling at different levels of phonetic granularity

Improving Noise Robustness In Speaker Identification Using A Two-Stage Attention Model

A Unified DNN Approach to Speaker-Dependent Simultaneous Speech Enhancement and Speech Separation in Low SNR Environments

Deep neural network based i-vector mapping for speaker verification using short utterances

Speaker Recognition System Based on Deep Neural Networks and Bottleneck Features

DNN-based Discriminative Scoring for Speaker Recognition Based on i-vector

Deep Speaker Embedding Learning with Multi-level Pooling for Text-independent Speaker Verification

Multi-task Joint-Learning of Deep Neural Networks for Robust Speech Recognition

Joint I-Vector with End-to-End System for Short Duration Text-Independent Speaker Verification.

Speech-enhanced and Noise-aware Networks for Robust Speech Recognition

DNN-Based Amplitude and Phase Feature Enhancement for Noise Robust Speaker Identification

Improved deep speaker feature learning for text-dependent speaker recognition

Deep Neural Network-Based Bottleneck Feature and Denoising Autoencoder-Based Dereverberation for Distant-Talking Speaker Identification.

Improving the Generalized Performance of Deep Embedding for Text-Independent Speaker Verification

Speech Enhancement Based on Deep Mixture of Distinguishing Experts

Robust Speech Recognition With Speech Enhanced Deep Neural Networks

Joint Feature Enhancement and Speaker Recognition with Multi-Objective Task-Oriented Network.