Abstract:In Autonomous Driving (AD) systems, perception is both security and safety critical. Despite various prior studies on its security issues, all of them only consider attacks on camera- or LiDAR-based AD perception alone. However, production AD systems today predominantly adopt a Multi-Sensor Fusion (MSF) based design, which in principle can be more robust against these attacks under the assumption that not all fusion sources are (or can be) attacked at the same time. In this paper, we present the first study of security issues of MSF-based perception in AD systems. We directly challenge the basic MSF design assumption above by exploring the possibility of attacking all fusion sources simultaneously. This allows us for the first time to understand how much security guarantee MSF can fundamentally provide as a general defense strategy for AD perception. We formulate the attack as an optimization problem to generate a physically-realizable, adversarial 3D-printed object that misleads an AD system to fail in detecting it and thus crash into it. We propose a novel attack pipeline that addresses two main design challenges: (1) non-differentiable target camera and LiDAR sensing systems, and (2) non-differentiable cell-level aggregated features popularly used in LiDAR-based AD perception. We evaluate our attack on MSF included in representative open-source industry-grade AD systems in real-world driving scenarios. Our results show that the attack achieves over 90% success rate across different object types and MSF. Our attack is also found stealthy, robust to victim positions, transferable across MSF algorithms, and physical-world realizable after being 3D-printed and captured by LiDAR and camera devices. To concretely assess the end-to-end safety impact, we further perform simulation evaluation and show that it can cause a 100% vehicle collision rate for an industry-grade AD system.

Demo: Security of Camera-based Perception for Autonomous Driving under Adversarial Attack

Adversarial Computer Vision Via Acoustic Manipulation of Camera Sensors

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Poltergeist: Acoustic Adversarial Machine Learning against Cameras and Computer Vision

Stealthy and Effective Physical Adversarial Attacks in Autonomous Driving

Driving into Danger: Adversarial Patch Attack on End-to-End Autonomous Driving Systems Using Deep Learning

Attacking vision-based perception in end-to-end autonomous driving models

Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving

Dynamic Adversarial Attacks on Autonomous Driving Systems

STOP! Camera Spoofing via the in-Vehicle IP Network

Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasures

Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patches

Adversarial Camera Patch: An Effective and Robust Physical-World Attack on Object Detectors

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Towards Physically-Realizable Adversarial Attacks in Embodied Vision Navigation

ControlLoc: Physical-World Hijacking Attack on Visual Perception in Autonomous Driving

Finding Physical Adversarial Examples for Autonomous Driving with Fast and Differentiable Image Compositing

Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attack

Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attack

Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks