Abstract:In this study, we delve into the robustness of neural network-based LiDAR point cloud tracking models under adversarial attacks, a critical aspect often overlooked in favor of performance enhancement. These models, despite incorporating advanced architectures like Transformer or Bird's Eye View (BEV), tend to neglect robustness in the face of challenges such as adversarial attacks, domain shifts, or data corruption. We instead focus on the robustness of the tracking models under the threat of adversarial attacks. We begin by establishing a unified framework for conducting adversarial attacks within the context of 3D object tracking, which allows us to thoroughly investigate both white-box and black-box attack strategies. For white-box attacks, we tailor specific loss functions to accommodate various tracking paradigms and extend existing methods such as FGSM, C\&W, and PGD to the point cloud domain. In addressing black-box attack scenarios, we introduce a novel transfer-based approach, the Target-aware Perturbation Generation (TAPG) algorithm, with the dual objectives of achieving high attack performance and maintaining low perceptibility. This method employs a heuristic strategy to enforce sparse attack constraints and utilizes random sub-vector factorization to bolster transferability. Our experimental findings reveal a significant vulnerability in advanced tracking methods when subjected to both black-box and white-box attacks, underscoring the necessity for incorporating robustness against adversarial attacks into the design of LiDAR point cloud tracking models. Notably, compared to existing methods, the TAPG also strikes an optimal balance between the effectiveness of the attack and the concealment of the perturbations.

A Comprehensive Study and Comparison of the Robustness of 3D Object Detectors Against Adversarial Attacks

A Comprehensive Study of the Robustness for LiDAR-Based 3D Object Detectors Against Adversarial Attacks

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Improving Adversarial Robustness of 3D Point Cloud Classification Models

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Unity is Strength? Benchmarking the Robustness of Fusion-based 3D Object Detection Against Physical Sensor Attack

On the Adversarial Robustness of Camera-based 3D Object Detection

Understanding Object Detection Through An Adversarial Lens

DetectS Ec: Evaluating the Robustness of Object Detection Models to Adversarial Attacks

D etect S ec : Evaluating the robustness of object detection models to adversarial attacks

Robustness of 3D Deep Learning in an Adversarial Setting

A Survey and Evaluation of Adversarial Attacks for Object Detection

Extending Adversarial Attacks and Defenses to Deep 3D Point Cloud Classifiers

On Adversarial Robustness of 3D Point Cloud Classification under Adaptive Attacks

Efficient Adversarial Attack Strategy Against 3D Object Detection in Autonomous Driving Systems

What's Wrong with the Robustness of Object Detectors?

Adversarial Point Cloud Perturbations Against 3D Object Detection in Autonomous Driving Systems

Adversarial Point Cloud Perturbations to Attack Deep Object Detection Models

A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks

Evaluating the Adversarial Robustness of Detection Transformers

Evaluating the Robustness of LiDAR Point Cloud Tracking Against Adversarial Attack