Abstract:Automatic speaker verification (ASV) systems have been widely applied in voice user interfaces to conduct person identification and access control via voiceprints. A typical ASV system consists of three stages, i.e., training, enrollment, and verification. Previous work has revealed that the ASV system can be bypassed at the training stage by backdoor attacks and at the verification stage by adversarial example attacks. In this paper, we propose a new type of backdoor attack aimed at the enrollment stage via adversarial ultrasound, named UltraBD, which is highly imperceptible, synchronization-free, and content-independent. By simultaneously injecting the ultrasound backdoor examples when the legitimate user initiates the enrollment, the polluted voiceprints stored in the ASV systems grant access to both the legitimate user and the adversary with relatively high confidence. Despite the challenges, i.e., when, what, and how the legitimate user articulates at the enrollment stage can be remarkably unpredictable and various, we managed to launch UltraBD by augmenting the generation and optimization process of the ultrasound backdoor examples with the randomness of synchronous time and relative amplitude ratio. Furthermore, we optimize the modulation mechanism of adversarial ultrasound by tuning the baseband signal on limited signal frequency points to improve its robustness in the physical world setting. We validate UltraBD on two common datasets together with two open-source ASV models. Results show that UltraBD can be robust to various configurations, e.g., different speakers and utterance content. In sum, our attack calls attention to a new attack surface of ASV systems and sheds light on its fundamental mechanisms.

Query-Efficient Adversarial Attack with Low Perturbation Against End-to-End Speech Recognition Systems

Echo: Reverberation-based Fast Black-Box Adversarial Attacks on Intelligent Audio Systems.

The Silent Manipulator: A Practical and Inaudible Backdoor Attack against Speech Recognition Systems

Towards Query-Efficient Adversarial Attacks Against Automatic Speech Recognition Systems

Remote Attacks on Speech Recognition Systems Using Sound from Power Supply

Query-Efficient Black-Box Adversarial Attacks on Automatic Speech Recognition.

Understanding and Benchmarking the Commonality of Adversarial Examples

UltraBD: Backdoor Attack against Automatic Speaker Verification Systems via Adversarial Ultrasound

Zero-Query Adversarial Attack on Black-box Automatic Speech Recognition Systems

IMPGA: an Effective and Imperceptible Black-Box Attack Against Automatic Speech Recognition Systems.

KENKU: Towards Efficient and Stealthy Black-box Adversarial Attacks against ASR Systems

Towards the Universal Defense for Query-Based Audio Adversarial Attacks on Speech Recognition System

Defending Adversarial Attacks on Cloud-aided Automatic Speech Recognition Systems.

Devil's Whisper: A General Approach for Physical Adversarial Attacks Against Commercial Black-box Speech Recognition Devices.

A Practical Black-Box Attack Against Autonomous Speech Recognition Model

Transferable Adversarial Attacks against ASR

Spoofing Speaker Verification System by Adversarial Examples Leveraging the Generalized Speaker Difference.

Towards the Universal Defense for Query-Based Audio Adversarial Attacks

ALIF: Low-Cost Adversarial Audio Attacks on Black-Box Speech Platforms using Linguistic Features

Imperceptible Black-Box Waveform-Level Adversarial Attack Towards Automatic Speaker Recognition

Adversarial Example Devastation and Detection on Speech Recognition System by Adding Random Noise