Abstract:Recent work has illuminated the vulnerability of speaker recognition systems (SRSs) against adversarial attacks, raising significant security concerns in deploying SRSs. However, they considered only a few settings (e.g., some combinations of source and target speakers), leaving many interesting and important settings in real-world attack scenarios alone. In this work, we present AS2T, the first attack in this domain which covers all the settings, thus allows the adversary to craft adversarial voices using arbitrary source and target speakers for any of three main recognition tasks. Since none of the existing loss functions can be applied to all the settings, we explore many candidate loss functions for each setting including the existing and newly designed ones. We thoroughly evaluate their efficacy and find that some existing loss functions are suboptimal. Then, to improve the robustness of AS2T towards practical over-the-air attack, we study the possible distortions occurred in over-the-air transmission, utilize different transformation functions with different parameters to model those distortions, and incorporate them into the generation of adversarial voices. Our simulated over-the-air evaluation validates the effectiveness of our solution in producing robust adversarial voices which remain effective under various hardware devices and various acoustic environments with different reverberation, ambient noises, and noise levels. Finally, we leverage AS2T to perform thus far the largest-scale evaluation to understand transferability among 14 diverse SRSs. The transferability analysis provides many interesting and useful insights which challenge several findings and conclusion drawn in previous works in the image domain. Our study also sheds light on future directions of adversarial attacks in the speaker recognition domain.

AdvTTS: Adversarial Text-to-Speech Synthesis Attack on Speaker Identification Systems.

The Silent Manipulator: A Practical and Inaudible Backdoor Attack against Speech Recognition Systems

Spoofing Speaker Verification System by Adversarial Examples Leveraging the Generalized Speaker Difference.

UltraBD: Backdoor Attack against Automatic Speaker Verification Systems via Adversarial Ultrasound

Timbre-reserved Adversarial Attack in Speaker Identification

Spoofing Speaker Verification Systems with Deep Multi-speaker Text-to-speech Synthesis

AS2T: Arbitrary Source-To-Target Adversarial Attack on Speaker Recognition Systems

Can DeepFake Speech be Reliably Detected?

SUETA: Speaker-specific Utterance Ensemble Based Transfer Attack on Speaker Identification System

Pseudo-Siamese Network based Timbre-reserved Black-box Adversarial Attack in Speaker Identification

Adversarial Attacks and Robust Defenses in Speaker Embedding based Zero-Shot Text-to-Speech System

Black-box Attacks on Automatic Speaker Verification using Feedback-controlled Voice Conversion

Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasound

Adversarial speech for voice privacy protection from Personalized Speech generation

Transforming acoustic characteristics to deceive playback spoofing countermeasures of speaker verification systems

Voice Presentation Attack Detection Using Convolutional Neural Networks

"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real World

Fooling Speaker Identification Systems with Adversarial Background Music

Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples

Attack on Practical Speaker Verification System Using Universal Adversarial Perturbations

Defending Against Adversarial Attacks in Speaker Verification Systems