Abstract:In recent years, many deep learning models have been adopted in autonomous driving. At the same time, these models introduce new vulnerabilities that may compromise the safety of autonomous vehicles. Specifically, recent studies have demonstrated that adversarial attacks can cause a significant decline in detection precision of deep learning-based 3-D object detection models. Although driving safety is the ultimate concern for autonomous driving, there is no comprehensive study on the linkage between the performance of deep learning models and the driving safety of autonomous vehicles under adversarial attacks. In this article, we investigate the impact of two primary types of adversarial attacks, perturbation attacks, and patch attacks, on the driving safety of vision-based autonomous vehicles rather than the detection precision of deep learning models. In particular, we consider two state-of-the-art models in vision-based 3-D object detection: 1) Stereo R-CNN and 2) DSGN. To evaluate driving safety, we propose an end-to-end evaluation framework with a set of driving safety performance metrics. By analyzing the results of our extensive evaluation experiments, we find that: 1) the attack's impact on the driving safety of autonomous vehicles and the attack's impact on the precision of 3-D object detectors are decoupled and 2) the DSGN model demonstrates stronger robustness to adversarial attacks than the Stereo R-CNN model. In addition, we further investigate the causes behind the two findings with an ablation study. The findings of this article provide a new perspective to evaluate adversarial attacks and guide the selection of deep learning models in autonomous driving.

Attacking End-to-End Visual Navigation Model: How Weak Existing Learning-Based Approaches Can Be?

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Attacking vision-based perception in end-to-end autonomous driving models

Adversarial Driving: Attacking End-to-End Autonomous Driving

Enhancing Robustness of Indoor Robotic Navigation with Free-Space Segmentation Models Against Adversarial Attacks

Towards navigation without precise localization: Weakly supervised learning of goal-directed navigation cost map

Adversarial Attack Against Urban Scene Segmentation for Autonomous Vehicles

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Attack End-to-End Autonomous Driving through Module-Wise Noise

How Secure Are Large Language Models (LLMs) for Navigation in Urban Environments?

Learning Image Attacks toward Vision Guided Autonomous Vehicles

Towards Autonomous Driving Model Resistant to Adversarial Attack

Towards Physically-Realizable Adversarial Attacks in Embodied Vision Navigation

Universal Adversarial Attacks for Visual Odometry Systems

Finding Physical Adversarial Examples for Autonomous Driving with Fast and Differentiable Image Compositing

DeepGoal: Learning to drive with driving intention from human control demonstration

Driving into Danger: Adversarial Patch Attack on End-to-End Autonomous Driving Systems Using Deep Learning

Adversarial Reinforced Instruction Attacker for Robust Vision-Language Navigation

Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patterns

Moving Target Defense for Deep Visual Sensing against Adversarial Examples

PG-Attack: A Precision-Guided Adversarial Attack Framework Against Vision Foundation Models for Autonomous Driving