Are Self-Driving Cars Secure? Evasion Attacks against Deep Neural Networks for Steering Angle Prediction

Alesia Chernikova,Alina Oprea,Cristina Nita-Rotaru,BaekGyu Kim

DOI: https://doi.org/10.48550/arXiv.1904.07370

2019-04-16

Abstract:Deep Neural Networks (DNNs) have tremendous potential in advancing the vision for self-driving cars. However, the security of DNN models in this context leads to major safety implications and needs to be better understood. We consider the case study of steering angle prediction from camera images, using the dataset from the 2014 Udacity challenge. We demonstrate for the first time adversarial testing-time attacks for this application for both classification and regression settings. We show that minor modifications to the camera image (an L2 distance of 0.82 for one of the considered models) result in mis-classification of an image to any class of attacker's choice. Furthermore, our regression attack results in a significant increase in Mean Square Error (MSE) by a factor of 69 in the worst case.

Machine Learning,Cryptography and Security

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the safety issue when deep neural networks (DNNs) are used to predict the steering angle in self - driving cars. Specifically, the author is concerned with the possibility of adversarial attacks on DNN models during the testing phase, which may lead to misclassification of the model or inaccurate regression predictions. The paper explores this problem in the following two aspects: 1. **Classification task**: The author studies how to make the model misclassify an input image into a category selected by the attacker by making minor modifications to the input image (for example, with an L2 distance of 0.82). For self - driving cars, this kind of attack may cause the vehicle to make wrong steering decisions. 2. **Regression task**: The author designs a test - time attack method for regression tasks, which can significantly increase the mean - squared error (MSE). Experimental results show that in the worst - case scenario, the MSE can be increased by 69 times. The main contribution of the paper is that it is the first to demonstrate adversarial attacks on the steering - angle prediction task in self - driving cars, emphasizes the importance of the safety of deep - learning models in the field of self - driving, and calls for further research on safety issues in this area.

Are Self-Driving Cars Secure? Evasion Attacks against Deep Neural Networks for Steering Angle Prediction

Adversarial Driving: Attacking End-to-End Autonomous Driving

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Finding Physical Adversarial Examples for Autonomous Driving with Fast and Differentiable Image Compositing

Self-Driving Car Steering Angle Prediction Based on Image Recognition

Attacking vision-based perception in end-to-end autonomous driving models

An Analysis of Adversarial Attacks and Defenses on Autonomous Driving Models

Adversarial Attacks on Multi-task Visual Perception for Autonomous Driving

Learning Image Attacks toward Vision Guided Autonomous Vehicles

Runtime Stealthy Perception Attacks against DNN-based Adaptive Cruise Control Systems

Security of Deep Learning based Lane Keeping System under Physical-World Adversarial Attack

Attack End-to-End Autonomous Driving through Module-Wise Noise

Detection of Adversarial Physical Attacks in Time-Series Image Data

Mitigating Deep Learning Vulnerabilities from Adversarial Examples Attack in the Cybersecurity Domain

Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues

DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars

Towards Autonomous Driving Model Resistant to Adversarial Attack

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Sensor Data Validation and Driving Safety in Autonomous Driving Systems

Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey

Driving into Danger: Adversarial Patch Attack on End-to-End Autonomous Driving Systems Using Deep Learning