Abstract:Despite the great success of speaker recognition models based on deep neural networks, deploying a pre-trained model in real-world scenarios often leads to significant performance degradation due to the domain mismatch between training and testing conditions. Various adaptation methods have been developed to address this issue by modifying either the front-end embedding network or the back-end scoring model. However, existing methods typically rely on knowledge of the network, scoring model, or even the source data. In this study, we introduce a knowledge-free adaptation approach that only necessitates the unlabeled target data. Our core concept is based on the assumption that domain mismatch primarily stems from distributional distortion in the embedding space, such as shifting, rotation, and scaling while maintaining inter-speaker discrimination for data from unknown domains. Building on this assumption, we propose clustering LDA (C-LDA), a full-rank linear discriminant analysis (LDA) based on agglomerative hierarchical clustering (AHC) to compensate for this distortion. This approach does not need any human labels and does not rely on any knowledge of the model in the source domain, making it suitable for real-world applications. Theoretical analysis indicates that with cosine scoring, C-LDA is capable of eliminating distributional distortion related to global shift and within-speaker covariance rotation and scaling. Surprisingly, our experiments demonstrated that this simple approach can outperform more complex methods that require full or partial knowledge, including front-end approaches such as fine-tuning and distribution alignment, and back-end approaches such as unsupervised probabilistic linear discriminant analysis (PLDA) adaptation. Additional experiments demonstrated that C-LDA is insensitive to hyperparameters and works well in both multi-domain and single-domain adaptation scenarios.

Source -Free Domain Adaptation for Speaker Verification in Data-Scarce Languages and Noisy Channels

Domain Adaptation Using Suitable Pseudo Labels for Speech Enhancement and Dereverberation

Adversarial Domain Adaptation for Speaker Verification Using Partially Shared Network.

Spoofing-Aware Speaker Verification with Unsupervised Domain Adaptation

Self-Supervised Learning Based Domain Adaptation for Robust Speaker Verification

Cross-lingual Text-independent Speaker Verification using Unsupervised Adversarial Discriminative Domain Adaptation

Multi-source Domain Adaptation for Text-independent Forensic Speaker Recognition

Domain adaptation based Speaker Recognition on Short Utterances

Automatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representations

Channel Adaptation for Speaker Verification Using Optimal Transport with Pseudo Label

Multi-Domain Adaptation by Self-Supervised Learning for Speaker Verification

A Simple Unsupervised Knowledge-Free Domain Adaptation for Speaker Recognition

Distance Metric-Based Open-Set Domain Adaptation for Speaker Verification

Domain Adaptation For Formant Estimation Using Deep Learning

VAE-based Domain Adaptation for Speaker Verification.

Contrastive Learning and Inter-Speaker Distribution Alignment Based Unsupervised Domain Adaptation for Robust Speaker Verification

Unsupervised Domain Adaptation Via Domain Adversarial Training for Speaker Recognition.

Text Only Domain Adaptation with Phoneme Guided Data Splicing for End-to-End Speech Recognition

Class-Aware Distribution Alignment Based Unsupervised Domain Adaptation for Speaker Verification

A source free domain adaptation model based on adversarial learning for image classification

Unsupervised Domain Adaptation for Robust Speech Recognition via Variational Autoencoder-Based Data Augmentation