Abstract:Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the long-tailed distribution, sparsity, and rarity in real-world data sets. To tackle this problem, in this paper, we introduce a natural adversarial scenario generation solution using naturalistic human driving priors and reinforcement learning techniques. By doing this, we can obtain large-scale test scenarios that are both diverse and realistic. Specifically, we build a simulation environment that mimics natural traffic interaction scenarios. Informed by this environment, we implement a two-stage procedure. The first stage incorporates conventional rule-based models, e.g., IDM~(Intelligent Driver Model) and MOBIL~(Minimizing Overall Braking Induced by Lane changes) model, to coarsely and discretely capture and calibrate key control parameters from the real-world dataset. Next, we leverage GAIL~(Generative Adversarial Imitation Learning) to represent driver behaviors continuously. The derived GAIL can be further used to design a PPO~(Proximal Policy Optimization)-based actor-critic network framework to fine-tune the reward function, and then optimizes our natural adversarial scenario generation solution. Extensive experiments have been conducted in the NGSIM dataset including the trajectory of 3,000 vehicles. Essential traffic parameters were measured in comparison with the baseline model, e.g., the collision rate, accelerations, steering, and the number of lane changes. Our findings demonstrate that the proposed model can generate realistic safety-critical test scenarios covering both naturalness and adversariality, which can be a cornerstone for the development of autonomous vehicles.

SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generation

AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

SEAS: Self-Evolving Adversarial Safety Optimization for Large Language Models

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Driving

CAT: Closed-loop Adversarial Training for Safe End-to-End Driving

Closed-Loop Simulation Test Method for Autonomous Vehicles Based on Adversarial Scenarios

GOOSE: Goal-Conditioned Reinforcement Learning for Safety-Critical Scenario Generation

ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Models

CRASH: Challenging Reinforcement-Learning Based Adversarial Scenarios For Safety Hardening

Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components

ReGentS: Real-World Safety-Critical Driving Scenario Generation Made Stable

Towards exploring adversarial learning for anomaly detection in complex driving scenes

SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries

Learning to Drive via Asymmetric Self-Play

Quantitative Representation of Scenario Difficulty for Autonomous Driving Based on Adversarial Policy Search

Multimodal Safety-Critical Scenarios Generation for Decision-Making Algorithms Evaluation

Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation

Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation

ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehicles