Abstract:Recent advances in deep learning have markedly improved autonomous driving (AD) models, particularly end-to-end systems that integrate perception, prediction, and planning stages, achieving state-of-the-art performance. However, these models remain vulnerable to adversarial attacks, where human-imperceptible perturbations can disrupt decision-making processes. While adversarial training is an effective method for enhancing model robustness against such attacks, no prior studies have focused on its application to end-to-end AD models. In this paper, we take the first step in adversarial training for end-to-end AD models and present a novel Module-wise Adaptive Adversarial Training (MA2T). However, extending conventional adversarial training to this context is highly non-trivial, as different stages within the model have distinct objectives and are strongly interconnected. To address these challenges, MA2T first introduces Module-wise Noise Injection, which injects noise before the input of different modules, targeting training models with the guidance of overall objectives rather than each independent module loss. Additionally, we introduce Dynamic Weight Accumulation Adaptation, which incorporates accumulated weight changes to adaptively learn and adjust the loss weights of each module based on their contributions (accumulated reduction rates) for better balance and robust training. To demonstrate the efficacy of our defense, we conduct extensive experiments on the widely-used nuScenes dataset across several end-to-end AD models under both white-box and black-box attacks, where our method outperforms other baselines by large margins (+5-10%). Moreover, we validate the robustness of our defense through closed-loop evaluation in the CARLA simulation environment, showing improved resilience even against natural corruption.

Driving into Danger: Adversarial Patch Attack on End-to-End Autonomous Driving Systems Using Deep Learning

Clean-Annotation Backdoor Attack against Lane Detection Systems in the Wild

Attack End-to-End Autonomous Driving through Module-Wise Noise

Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey

Dynamic Adversarial Attacks on Autonomous Driving Systems

Adversarial Driving: Attacking End-to-End Autonomous Driving

Attacking vision-based perception in end-to-end autonomous driving models

Feasibility and Suppression of Adversarial Patch Attacks on End-to-End Vehicle Control

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems

Stealthy and Effective Physical Adversarial Attacks in Autonomous Driving

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Security of Deep Learning based Lane Keeping System under Physical-World Adversarial Attack

Mitigating Deep Learning Vulnerabilities from Adversarial Examples Attack in the Cybersecurity Domain

Demo: Security of Camera-based Perception for Autonomous Driving under Adversarial Attack

Deep Learning-Based Autonomous Driving Systems: A Survey of Attacks and Defenses

Physical Backdoor Attacks to Lane Detection Systems in Autonomous Driving

Module-wise Adaptive Adversarial Training for End-to-end Autonomous Driving

Finding Physical Adversarial Examples for Autonomous Driving with Fast and Differentiable Image Compositing

An Adversarial Attack on Salient Regions of Traffic Sign

An Analysis of Adversarial Attacks and Defenses on Autonomous Driving Models