Abstract:Nowadays, autonomous driving has attracted much attention from both industry and academia. Convolutional neural network (CNN) is a key component in autonomous driving, which is also increasingly adopted in pervasive computing such as smartphones, wearable devices, and IoT networks. Prior work shows CNN-based classification models are vulnerable to adversarial attacks. However, it is uncertain to what extent regression models such as driving models are vulnerable to adversarial attacks, the effectiveness of existing defense techniques, and the defense implications for system and middleware builders. This paper presents an in-depth analysis of five adversarial attacks and four defense methods on three driving models. Experiments show that, similar to classification models, these models are still highly vulnerable to adversarial attacks. This poses a big security threat to autonomous driving and thus should be taken into account in practice. While these defense methods can effectively defend against different attacks, none of them are able to provide adequate protection against all five attacks. We derive several implications for system and middleware builders: (1) when adding a defense component against adversarial attacks, it is important to deploy multiple defense methods in tandem to achieve a good coverage of various attacks, (2) a blackbox attack is much less effective compared with a white-box attack, implying that it is important to keep model details (e.g., model architecture, hyperparameters) confidential via model obfuscation, and (3) driving models with a complex architecture are preferred if computing resources permit as they are more resilient to adversarial attacks than simple models.

A Model Checking Based Approach to Detect Safety-Critical Adversarial Examples on Autonomous Driving Systems

Adversarial Attacks and Mitigation for Anomaly Detectors of Cyber-Physical Systems

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

An Adversarial Attack Defending System for Securing In-Vehicle Networks

Strategic Safety-Critical Attacks Against an Advanced Driver Assistance System

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Driving into Danger: Adversarial Patch Attack on End-to-End Autonomous Driving Systems Using Deep Learning

Towards exploring adversarial learning for anomaly detection in complex driving scenes

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Model Checking for Reinforcement Learning in Autonomous Driving: One Can Do More Than You Think!

Model-based Verification and Validation of an Autonomous Vehicle System

Deep Learning-Based Autonomous Driving Systems: A Survey of Attacks and Defenses

Sensor Data Validation and Driving Safety in Autonomous Driving Systems

CAT: Closed-loop Adversarial Training for Safe End-to-End Driving

MOSAT: Finding Safety Violations of Autonomous Driving Systems Using Multi-Objective Genetic Algorithm.

Interpreting Adversarial Examples and Robustness for Deep Learning-Based Auto-Driving Systems

An Analysis of Adversarial Attacks and Defenses on Autonomous Driving Models

Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attack

Road to safe autonomy with data and formal reasoning

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems