Abstract:Recent studies have shown that frame-level deep speaker features can be derived from a deep neural network with the training target set to discriminate speakers by a short speech segment. By pooling the frame-level features, utterance-level representations, called d-vectors, can be derived and used in the automatic speaker verification (ASV) task. This simple average pooling, however, is inherently sensitive to the phonetic content of the utterance. An interesting idea borrowed from machine translation is the attention-based mechanism, where the contribution of an input word to the translation at a particular time is weighted by an attention score. This score reflects the relevance of the input word and the present translation. We can use the same idea to align utterances with different phonetic contents. This paper proposes a phonetic-attention scoring approach for d-vector systems. By this approach, an attention score is computed for each frame pair. This score reflects the similarity of the two frames in phonetic content, and is used to weigh the contribution of this frame pair in the utterance-based scoring. This new scoring approach emphasizes the frame pairs with similar phonetic contents, which essentially provides a soft alignment for utterances with any phonetic contents. Experimental results show that compared with the naive average pooling, this phonetic-attention scoring approach can deliver consistent performance improvement in ASV tasks of both text-dependent and text-independent.

Investigation of Frame Alignments for GMM-based Digit-prompted Speaker Verification.

Experimental Investigation into Alignment-based Acoustic Confidence Measures in Keyword Verification for Mandarin Speech

Text-Independent Speaker Verification Via State Alignment.

Scores Selection for Emotional Speaker Recognition

GMM-ResNext: Combining Generative and Discriminative Models for Speaker Verification

Text Prompted Speaker Verification Based On Phoneme Clustering With Earth Mover'S Distane And Cauchy-Schwarz Divergence

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

Deep neural networks based speaker modeling at different levels of phonetic granularity

Speaker Verification Using Adapted Gaussian Mixture Models

Log-Likelihood Kernels Based on Adapted GMMs for Speaker Verification

Discriminative Dynamic Gaussian Mixture Selection with Enhanced Robustness and Performance for Multi-Accent Speech Recognition

Comparison of Multiple Features and Modeling Methods for Text-dependent Speaker Verification

Phonetic-Attention Scoring for Deep Speaker Features in Speaker Verification

Exploiting Glottal Information in Speaker Recognition Using Parallel GMMs

Joint Bayesian Gaussian Discriminant Analysis for Speaker Verification.

Two-Path GMM-ResNet and GMM-SENet for ASV Spoofing Detection

AlignMMBench: Evaluating Chinese Multimodal Alignment in Large Vision-Language Models

Multiple Background Models for Speaker Verification.

Gaussian-Constrained training for speaker verification

Combined GMM-UBM and SVM Speaker Identification System

Channel Compensation Technology In Differential Gsv-Svm Speaker Verification System