Abstract:Photoplethysmography (PPG) sensors have become integral components of wearable and portable health devices in the current technological landscape. These sensors offer easy access to heart rate and blood oxygenation, facilitating continuous long-term health monitoring in clinic and non-clinic environments. While people understand that health-related information provided by PPG is private, no existing research has demonstrated that PPG sensors are dangerous devices capable of obtaining sensitive information other than health-related data. This work introduces PPG-Hear, a novel side-channel attack that exploits PPG sensors to intercept nearby audio information covertly. Specifically, PPG-Hear exploits low-frequency PPG measurements to discern and reconstruct human speech emitted from proximate speakers. This technology allows attackers to eavesdrop on sensitive conversations (e.g., audio passwords, business decisions, or intellectual properties) without being noticed. To achieve this non-trivial attack on commodity PPG-enabled devices, we employ differentiation and filtering techniques to mitigate the impact of temperature drift and user-specific gestures. We develop the first PPG-based speech reconstructor, which can identify speech patterns in the PPG spectrogram and establish the correlation between PPG and speech spectrograms. By integrating a MiniRocket-based classifier with a PixelGAN model, PPG-Hear can reconstruct human speech using low-sampling-rate PPG measurements. Through an array of real-world experiments, encompassing common eavesdropping scenarios such as surrounding speakers and the device's own speakers, we show that PPG-Hear can achieve remarkable accuracy of 90% for recognizing human speech, surpassing the current state-of-the-art side-channel eavesdropping attacks using motion sensors operating at equivalent sampling rates (i.e., 50Hz to 500Hz).

Hard Drive of Hearing: Disks That Eavesdrop with a Synthesized Microphone

Mmear: Push the Limit of COTS Mmwave Eavesdropping on Headphones

Echo: Reverberation-based Fast Black-Box Adversarial Attacks on Intelligent Audio Systems.

Remote Attacks on Speech Recognition Systems Using Sound from Power Supply

DiskFiltration: Data Exfiltration from Speakerless Air-Gapped Computers via Covert Hard Drive Noise

Black Hole of Sound: Constructing an Anti-eavesdropping Area Using Ultrasound

The Silent Manipulator: A Practical and Inaudible Backdoor Attack against Speech Recognition Systems

EarArray: Defending Against DolphinAttack Via Acoustic Attenuation

Blue Note: How Intentional Acoustic Interference Damages Availability and Integrity in Hard Disk Drives and Operating Systems

An Eavesdropping System Based on Magnetic Side-Channel Signals Leaked by Speakers

Replay-resistant Disk Fingerprinting Via Unintentional Electromagnetic Emanations

MagBackdoor: Beware of Your Loudspeaker As A Backdoor for Magnetic Injection Attacks.

Indelible “footprints” of Inaudible Command Injection

Spying with your robot vacuum cleaner: eavesdropping via lidar sensors

Synesthesia: Detecting Screen Content via Remote Acoustic Side Channels

PPG-Hear: A Practical Eavesdropping Attack with Photoplethysmography Sensors

SPEAKE(a)R: Turn Speakers to Microphones for Fun and Profit

Fansmitter: Acoustic Data Exfiltration from (Speakerless) Air-Gapped Computers

Privacy Threats of Acoustic Covert Communication among Smart Mobile Devices

Implement of a Secure Selective Ultrasonic Microphone Jammer

Audio Hotspot Attack: An Attack on Voice Assistance Systems Using Directional Sound Beams and its Feasibility