Abstract:Camera-based autonomous systems that emulate human perception are increasingly being integrated into safety-critical platforms. Consequently, an established body of literature has emerged that explores adversarial attacks targeting the underlying machine learning models. Adapting adversarial attacks to the physical world is desirable for the attacker, as this removes the need to compromise digital systems. However, the real world poses challenges related to the "survivability" of adversarial manipulations given environmental noise in perception pipelines and the dynamicity of autonomous systems. In this paper, we take a sensor-first approach. We present EvilEye, a man-in-the-middle perception attack that leverages transparent displays to generate dynamic physical adversarial examples. EvilEye exploits the camera's optics to induce misclassifications under a variety of illumination conditions. To generate dynamic perturbations, we formalize the projection of a digital attack into the physical domain by modeling the transformation function of the captured image through the optical pipeline. Our extensive experiments show that EvilEye's generated adversarial perturbations are much more robust across varying environmental light conditions relative to existing physical perturbation frameworks, achieving a high attack success rate (ASR) while bypassing state-of-the-art physical adversarial detection frameworks. We demonstrate that the dynamic nature of EvilEye enables attackers to adapt adversarial examples across a variety of objects with a significantly higher ASR compared to state-of-the-art physical world attack frameworks. Finally, we discuss mitigation strategies against the EvilEye attack.

Poltergeist: Acoustic Adversarial Machine Learning against Cameras and Computer Vision

Adversarial Computer Vision Via Acoustic Manipulation of Camera Sensors

Echo: Reverberation-based Fast Black-Box Adversarial Attacks on Intelligent Audio Systems.

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

PLA-LiDAR: Physical Laser Attacks Against LiDAR-based 3D Object Detection in Autonomous Vehicle.

Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving

Dynamic Adversarial Attacks on Autonomous Driving Systems

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Partial-Information, Longitudinal Cyber Attacks on LiDAR in Autonomous Vehicles

Stealthy and Effective Physical Adversarial Attacks in Autonomous Driving

Why Don't You Clean Your Glasses? Perception Attacks with Dynamic Optical Perturbations

Detecting and Identifying Optical Signal Attacks on Autonomous Driving Systems

Learning Image Attacks toward Vision Guided Autonomous Vehicles

GhostImage: Remote Perception Attacks against Camera-based Image Classification Systems

Counteracting Adversarial Attacks in Autonomous Driving

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasures

Challenging AI+Camera Systems with Physical Adversarial Attacks

Detection of Adversarial Physical Attacks in Time-Series Image Data

Exploring Adversarial Robustness of LiDAR-Camera Fusion Model in Autonomous Driving

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems