Abstract:Deep learning models have been demonstrated vulnerable to adversarial attacks even with imperceptible perturbations. As such, the reliability of existing deep neural networks-based autonomous driving systems can suffer. However, deep 3D models have applications in various Cyber-Physical Systems (CPSs) with safety-critical requirements, particularly autonomous driving systems. In this paper, the robustness of deep 3D object detection models under adversarial point cloud perturbations has been investigated. A novel method is developed to generate 3D adversarial examples from point cloud perturbations, which are common due to the intrinsic characteristics of the data captured by 3D sensors, e.g., LiDAR. The generation of adversarial samples is supervised by a dual loss, which constitutes an adversarial loss and a perturbation loss. The adversarial loss produces a point cloud with the property of aggressiveness, while the perturbation loss enforces the produced point cloud subject to visual imperception. We demonstrate that the method can successfully attack 3D object detection models in most cases, and expose their vulnerability to physical-world attacks in the form of point cloud perturbations. We perform a thorough evaluation of popular deep 3D object detectors in an adversarial setting on the KITTI vision benchmark. Experimental results show that current deep 3D object detection models are susceptible to adversarial attacks in the context of autonomous driving, and their performances are degraded by a large margin in the presence of adversarial point clouds generated by the proposed method.

Generating 3D Adversarial Point Clouds under the Principle of LiDARs

PLA-LiDAR: Physical Laser Attacks Against LiDAR-based 3D Object Detection in Autonomous Vehicle.

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Laser-Based LiDAR Spoofing: Effects Validation, Capability Quantification, and Countermeasures

Adversarial Obstacle Generation Against LiDAR-Based 3D Object Detection

Improving Adversarial Robustness of 3D Point Cloud Classification Models

Adversarial Point Cloud Perturbations Against 3D Object Detection in Autonomous Driving Systems

SR-Adv: Salient Region Adversarial Attacks on 3D Point Clouds for Autonomous Driving

A New Adversarial Perspective for LiDAR-based 3D Object Detection

Generating 3D Adversarial Point Clouds

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems

Adversarial Point Cloud Perturbations to Attack Deep Object Detection Models

Cam-PC: A Novel Method for Camouflaging Point Clouds to Counter Adversarial Deception in Remote Sensing

A 3D Point Attacker for LiDAR-Based Localization

Saliency-Aware Generation of Adversarial Point Clouds.

Local Aggressive Adversarial Attacks on 3D Point Cloud

Adaptive Local Adversarial Attacks on 3D Point Clouds for Augmented Reality

Adversarial 3D Virtual Patches using Integrated Gradients

ADoPT: LiDAR Spoofing Attack Detection Based on Point-Level Temporal Consistency

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasures