Abstract:Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the long-tailed distribution, sparsity, and rarity in real-world data sets. To tackle this problem, in this paper, we introduce a natural adversarial scenario generation solution using naturalistic human driving priors and reinforcement learning techniques. By doing this, we can obtain large-scale test scenarios that are both diverse and realistic. Specifically, we build a simulation environment that mimics natural traffic interaction scenarios. Informed by this environment, we implement a two-stage procedure. The first stage incorporates conventional rule-based models, e.g., IDM~(Intelligent Driver Model) and MOBIL~(Minimizing Overall Braking Induced by Lane changes) model, to coarsely and discretely capture and calibrate key control parameters from the real-world dataset. Next, we leverage GAIL~(Generative Adversarial Imitation Learning) to represent driver behaviors continuously. The derived GAIL can be further used to design a PPO~(Proximal Policy Optimization)-based actor-critic network framework to fine-tune the reward function, and then optimizes our natural adversarial scenario generation solution. Extensive experiments have been conducted in the NGSIM dataset including the trajectory of 3,000 vehicles. Essential traffic parameters were measured in comparison with the baseline model, e.g., the collision rate, accelerations, steering, and the number of lane changes. Our findings demonstrate that the proposed model can generate realistic safety-critical test scenarios covering both naturalness and adversariality, which can be a cornerstone for the development of autonomous vehicles.

Traffic models with adversarial vehicle behaviour

Adversarial Driving Policy Learning by Misunderstanding the Traffic Flow

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

An Analytical Framework for Modeling and Synthesizing Malicious Attacks on ACC Vehicles

Cyberattacks on Adaptive Cruise Control Vehicles: An Analytical Characterization

Adversarial and Reactive Traffic Agents for Realistic Driving Simulation

Collective behavior and emergent risks in a model of human- and autonomously-driven vehicles

Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attack

Stop-and-Go: Exploring Backdoor Attacks on Deep Reinforcement Learning-based Traffic Congestion Control Systems

A Game Theory Approach To Attack-Defense Strategy For Perception Of Connected Vehicles

Dynamic Adversarial Attacks on Autonomous Driving Systems

Detecting stealthy cyberattacks on adaptive cruise control vehicles: A machine learning approach

Stealthy and Effective Physical Adversarial Attacks in Autonomous Driving

Realistic Extreme Behavior Generation for Improved AV Testing

Game-theoretic Modeling of Traffic in Unsignalized Intersection Network for Autonomous Vehicle Control Verification and Validation

Adversarial Evaluation of Autonomous Vehicles in Lane-Change Scenarios

Attacking vision-based perception in end-to-end autonomous driving models

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

Revisiting Physical-World Adversarial Attack on Traffic Sign Recognition: A Commercial Systems Perspective