Abstract:Despite the great success of speaker recognition models based on deep neural networks, deploying a pre-trained model in real-world scenarios often leads to significant performance degradation due to the domain mismatch between training and testing conditions. Various adaptation methods have been developed to address this issue by modifying either the front-end embedding network or the back-end scoring model. However, existing methods typically rely on knowledge of the network, scoring model, or even the source data. In this study, we introduce a knowledge-free adaptation approach that only necessitates the unlabeled target data. Our core concept is based on the assumption that domain mismatch primarily stems from distributional distortion in the embedding space, such as shifting, rotation, and scaling while maintaining inter-speaker discrimination for data from unknown domains. Building on this assumption, we propose clustering LDA (C-LDA), a full-rank linear discriminant analysis (LDA) based on agglomerative hierarchical clustering (AHC) to compensate for this distortion. This approach does not need any human labels and does not rely on any knowledge of the model in the source domain, making it suitable for real-world applications. Theoretical analysis indicates that with cosine scoring, C-LDA is capable of eliminating distributional distortion related to global shift and within-speaker covariance rotation and scaling. Surprisingly, our experiments demonstrated that this simple approach can outperform more complex methods that require full or partial knowledge, including front-end approaches such as fine-tuning and distribution alignment, and back-end approaches such as unsupervised probabilistic linear discriminant analysis (PLDA) adaptation. Additional experiments demonstrated that C-LDA is insensitive to hyperparameters and works well in both multi-domain and single-domain adaptation scenarios.

Domain-Invariant Speaker Vector Projection by Model-Agnostic Meta-Learning

Adversarial Training Based on Meta-Learning in Unseen Domains for Speaker Verification

Meta Representation Learning Method for Robust Speaker Verification in Unseen Domains.

VarASV: Enabling Pitch-variable Automatic Speaker Verification Via Multi-task Learning

VAE-based Domain Adaptation for Speaker Verification.

Multi-Domain Adaptation by Self-Supervised Learning for Speaker Verification

Designing Neural Speaker Embeddings with Meta Learning

Domain Robust Deep Embedding Learning for Speaker Recognition

Stargan-vc Based Cross-Domain Data Augmentation for Speaker Verification

Toward Domain-Invariant Speech Recognition via Large Scale Training

Generalized domain adaptation framework for parametric back-end in speaker recognition

Dual-model self-regularization and fusion for domain adaptation of robust speaker verification

EDITnet: A Lightweight Network for Unsupervised Domain Adaptation in Speaker Verification

Meta-Learning With Latent Space Clustering in Generative Adversarial Network for Speaker Diarization

Meta conditional variational auto-encoder for domain generalization

Unsupervised Domain Adaptation Via Domain Adversarial Training for Speaker Recognition.

Channel Adversarial Training for Cross-channel Text-independent Speaker Recognition

Adapting End-to-End Neural Speaker Verification to New Languages and Recording Conditions with Adversarial Training

A Simple Unsupervised Knowledge-Free Domain Adaptation for Speaker Recognition

DEAAN: Disentangled Embedding and Adversarial Adaptation Network for Robust Speaker Representation Learning

MVDG: A Unified Multi-view Framework for Domain Generalization