Abstract:Backdoor Attacks have been shown to pose significant threats to automatic speech recognition systems (ASRs). Existing success largely assumes backdoor triggering in the digital domain, or the victim will not notice the presence of triggering sounds in the physical domain. However, in practical victim-present scenarios, the over-the-air distortion of the backdoor trigger and the victim awareness raised by its audibility may invalidate such attacks. In this paper, we propose SMA, an inaudible grey-box backdoor attack that can be generalized to real-world scenarios where victims are present by exploiting both the vulnerability of microphones and neural networks. Specifically, we utilize the nonlinear effects of microphones to inject an inaudible ultrasonic trigger. To accurately characterize the microphone response to the crafted ultrasound, we construct a novel nonlinear transfer function for effective optimization. We also design optimization objectives to ensure triggers' robustness in the physical world and transferability on unseen ASR models. In practice, SMA can bypass the microphone's built-in filters and human perception, activating the implanted trigger in the ASRs inaudibly, regardless of whether the user is speaking. Extensive experiments show that the attack success rate of SMA can reach nearly 100% in the digital domain and over 85% against most microphones in the physical domains by only poisoning about 0.5% of the training audio dataset. Moreover, our attack can resist typical defense countermeasures to backdoor attacks.

MILLIEAR: Millimeter-wave Acoustic Eavesdropping with Unconstrained Vocabulary

Towards Unconstrained Vocabulary Eavesdropping with Mmwave Radar Using GAN

Mmear: Push the Limit of COTS Mmwave Eavesdropping on Headphones

Echo: Reverberation-based Fast Black-Box Adversarial Attacks on Intelligent Audio Systems.

Radar2: Passive Spy Radar Detection and Localization Using COTS Mmwave Radar

Poster Abstract: Environment-Independent Electronic Device Detection using Millimeter-Wave

EarArray: Defending Against DolphinAttack Via Acoustic Attenuation

Black Hole of Sound: Constructing an Anti-eavesdropping Area Using Ultrasound

Poster: Inaudible High-throughput Communication Through Acoustic Signals

Mmeavesdropper: Signal Augmentation-based Directional Eavesdropping with Mmwave Radar.

The Silent Manipulator: A Practical and Inaudible Backdoor Attack against Speech Recognition Systems

Mmphone: Acoustic Eavesdropping on Loudspeakers Via Mmwave-Characterized Piezoelectric Effect

Wavesdropper

mmWave-Whisper: Phone Call Eavesdropping and Transcription Using Millimeter-Wave Radar

Speech Acquisition and Recovery Based on Piezoelectric Effect in the Mmwave Band

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

AmbiEar: mmWave Based Voice Recognition in NLoS Scenarios

VoiceListener

An Eavesdropping System Based on Magnetic Side-Channel Signals Leaked by Speakers

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.