Abstract:Despite the great success of speaker recognition models based on deep neural networks, deploying a pre-trained model in real-world scenarios often leads to significant performance degradation due to the domain mismatch between training and testing conditions. Various adaptation methods have been developed to address this issue by modifying either the front-end embedding network or the back-end scoring model. However, existing methods typically rely on knowledge of the network, scoring model, or even the source data. In this study, we introduce a knowledge-free adaptation approach that only necessitates the unlabeled target data. Our core concept is based on the assumption that domain mismatch primarily stems from distributional distortion in the embedding space, such as shifting, rotation, and scaling while maintaining inter-speaker discrimination for data from unknown domains. Building on this assumption, we propose clustering LDA (C-LDA), a full-rank linear discriminant analysis (LDA) based on agglomerative hierarchical clustering (AHC) to compensate for this distortion. This approach does not need any human labels and does not rely on any knowledge of the model in the source domain, making it suitable for real-world applications. Theoretical analysis indicates that with cosine scoring, C-LDA is capable of eliminating distributional distortion related to global shift and within-speaker covariance rotation and scaling. Surprisingly, our experiments demonstrated that this simple approach can outperform more complex methods that require full or partial knowledge, including front-end approaches such as fine-tuning and distribution alignment, and back-end approaches such as unsupervised probabilistic linear discriminant analysis (PLDA) adaptation. Additional experiments demonstrated that C-LDA is insensitive to hyperparameters and works well in both multi-domain and single-domain adaptation scenarios.

Local training for PLDA in speaker verification

Weakly Supervised PLDA Training.

Local Pairwise Linear Discriminant Analysis for Speaker Verification

Language-aware PLDA for multilingual speaker recognition

Multiobjective Optimization Training of PLDA for Speaker Verification

Single-sided approach to discriminative PLDA training for text-independent speaker verification without using expanded i-vector

Local Learning Multiple Probabilistic Linear Discriminant Analysis.

A Study on Decoupled Probabilistic Linear Discriminant Analysis

Domain adaptation based Speaker Recognition on Short Utterances

Cross-lingual Text-independent Speaker Verification using Unsupervised Adversarial Discriminative Domain Adaptation

Improving Deep Neural Networks Based Speaker Verification Using Unlabeled Data

A speaker verification backend with robust performance across conditions

Self-Supervised Learning with Cluster-Aware-DINO for High-Performance Robust Speaker Verification

Neural Discriminant Analysis for Deep Speaker Embedding

Generalized domain adaptation framework for parametric back-end in speaker recognition

Squeezing value of cross-domain labels: a decoupled scoring approach for speaker verification

A Simple Unsupervised Knowledge-Free Domain Adaptation for Speaker Recognition

Front-End Factor Analysis For Speaker Verification

Improving Short Utterance PLDA Speaker Verification using SUV Modelling and Utterance Partitioning Approach

Gaussian-Constrained training for speaker verification