Abstract:Advancements in voice conversion (VC) technology have made it easier to generate spoofed speech that closely resembles the identity of a target speaker. Meanwhile, verification systems within the realm of speech processing are widely used to identify speakers. However, the misuse of VC algorithms poses significant privacy and security risks by potentially deceiving these systems. To address this issue, source speaker verification (SSV) has been proposed to verify the source speaker's identity of the spoofed speech generated by VCs. Nevertheless, SSV often suffers severe performance degradation when confronted with unknown VC algorithms, which is usually neglected by researchers. To deal with this cross-voice-conversion scenario and enhance the model's performance when facing unknown VC methods, we redefine it as a novel domain adaptation task by treating each VC method as a distinct domain. In this context, we propose an unsupervised domain adaptation (UDA) algorithm termed self-distillation-based domain exploration (SDDE). This algorithm adopts a siamese framework with two branches: one trained on the source (known) domain and the other trained on the target domains (unknown VC methods). The branch trained on the source domain leverages supervised learning to capture the source speaker's intrinsic features. Meanwhile, the branch trained on the target domain employs self-distillation to explore target domain information from multi-scale segments. Additionally, we have constructed a large-scale data set comprising over 7,945 h of spoofed speech to evaluate the proposed SDDE. Experimental results on this data set demonstrate that SDDE outperforms traditional UDAs and substantially enhances the performance of the SSV model under unknown VC scenarios. The code for data generation and the trial lists are available at https://github.com/zrtlemontree/cross-domain-source-speaker-verification .

Self-distillation-based domain exploration for source speaker verification under spoofed speech from unknown voice conversion

Enhancing Out-of-Domain Detection for Speech Spoofing Countermeasure Via Supervised Contrastive Learning

Spoofing-Aware Speaker Verification with Unsupervised Domain Adaptation

Self-Supervised Learning Based Domain Adaptation for Robust Speaker Verification

Class-Aware Distribution Alignment Based Unsupervised Domain Adaptation for Speaker Verification

Voice Presentation Attack Detection Using Convolutional Neural Networks

Stargan-vc Based Cross-Domain Data Augmentation for Speaker Verification

Generalizing Speaker Verification for Spoof Awareness in the Embedding Space

Contrastive Learning and Inter-Speaker Distribution Alignment Based Unsupervised Domain Adaptation for Robust Speaker Verification

Can large-scale vocoded spoofed data improve speech spoofing countermeasure with a self-supervised front end?

Spoofing-Aware Speaker Verification Robust Against Domain and Channel Mismatches

Adversarial Speaker Disentanglement Using Unannotated External Data for Self-supervised Representation Based Voice Conversion

Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples

Boosting Cross-Domain Speech Recognition with Self-Supervision

Identifying Source Speakers for Voice Conversion based Spoofing Attacks on Speaker Verification Systems

Multi-Domain Adaptation by Self-Supervised Learning for Speaker Verification

Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verification

Cross-Domain Replay Spoofing Attack Detection Using Domain Adversarial Training.

Cross-lingual Text-independent Speaker Verification using Unsupervised Adversarial Discriminative Domain Adaptation

Multi-task Learning Based Spoofing-Robust Automatic Speaker Verification System