Abstract:Despite the great success of speaker recognition models based on deep neural networks, deploying a pre-trained model in real-world scenarios often leads to significant performance degradation due to the domain mismatch between training and testing conditions. Various adaptation methods have been developed to address this issue by modifying either the front-end embedding network or the back-end scoring model. However, existing methods typically rely on knowledge of the network, scoring model, or even the source data. In this study, we introduce a knowledge-free adaptation approach that only necessitates the unlabeled target data. Our core concept is based on the assumption that domain mismatch primarily stems from distributional distortion in the embedding space, such as shifting, rotation, and scaling while maintaining inter-speaker discrimination for data from unknown domains. Building on this assumption, we propose clustering LDA (C-LDA), a full-rank linear discriminant analysis (LDA) based on agglomerative hierarchical clustering (AHC) to compensate for this distortion. This approach does not need any human labels and does not rely on any knowledge of the model in the source domain, making it suitable for real-world applications. Theoretical analysis indicates that with cosine scoring, C-LDA is capable of eliminating distributional distortion related to global shift and within-speaker covariance rotation and scaling. Surprisingly, our experiments demonstrated that this simple approach can outperform more complex methods that require full or partial knowledge, including front-end approaches such as fine-tuning and distribution alignment, and back-end approaches such as unsupervised probabilistic linear discriminant analysis (PLDA) adaptation. Additional experiments demonstrated that C-LDA is insensitive to hyperparameters and works well in both multi-domain and single-domain adaptation scenarios.

Supervised And Unsupervised Speaker Adaptation Using Confidence Measure

Agmma: A Novel Incremental Adaptation Method And Its Application To Speaker Recognition

Confidence Measure Based Incremental Adaptation For Online Language Identification

Unsupervised Speaker Adaptation Of Deep Neural Network Based On The Combination Of Speaker Codes And Singular Value Decomposition For Speech Recognition

Confidence Measure Based on Context Consistency Using Word Occurrence Probability and Topic Adaptation for Spoken Term Detection

Survey of Speaker Adaptation Methods in Speech Recognition

Speaker adaptation using maximum likelihood model interpolation

Unsupervised Speaker Adaptation of Blstm-Rnn for Lvcsr Based on Speaker Code

Dynamic Speaker Selected Training for Rapid Speaker Adaptation

Speech Recognition Using Speaker Adaptation by System Parameter Transformation.

An Unsupervised Speaker Adaptation Method Based on VQ-HMM

Speaker Adaptation for Telephony Data Using Speaker Clustering

A Simple Unsupervised Knowledge-Free Domain Adaptation for Speaker Recognition

Confidence-features and Confidence-Scores for ASR Applications in Arbitration and DNN Speaker Adaptation.

Speaker Adaptation with Transformation Matrix Linear Interpolation

MAP-based Speaker Adaptation in Speech Synthesis

Speaker Adaptation of Hybrid NN/HMM Model for Speech Recognition Based on Singular Value Decomposition

Unsupervised Speaker Adaptation Based On FVQ/HMM

Phoneme Dependent Speaker Embedding And Model Factorization For Multi-Speaker Speech Synthesis And Adaptation

A Combined Speaker Adaptation Method for Mandarin Speech Recognition

Discriminative Speaker Adaptation with Eigenvoices