Abstract:Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the long-tailed distribution, sparsity, and rarity in real-world data sets. To tackle this problem, in this paper, we introduce a natural adversarial scenario generation solution using naturalistic human driving priors and reinforcement learning techniques. By doing this, we can obtain large-scale test scenarios that are both diverse and realistic. Specifically, we build a simulation environment that mimics natural traffic interaction scenarios. Informed by this environment, we implement a two-stage procedure. The first stage incorporates conventional rule-based models, e.g., IDM~(Intelligent Driver Model) and MOBIL~(Minimizing Overall Braking Induced by Lane changes) model, to coarsely and discretely capture and calibrate key control parameters from the real-world dataset. Next, we leverage GAIL~(Generative Adversarial Imitation Learning) to represent driver behaviors continuously. The derived GAIL can be further used to design a PPO~(Proximal Policy Optimization)-based actor-critic network framework to fine-tune the reward function, and then optimizes our natural adversarial scenario generation solution. Extensive experiments have been conducted in the NGSIM dataset including the trajectory of 3,000 vehicles. Essential traffic parameters were measured in comparison with the baseline model, e.g., the collision rate, accelerations, steering, and the number of lane changes. Our findings demonstrate that the proposed model can generate realistic safety-critical test scenarios covering both naturalness and adversariality, which can be a cornerstone for the development of autonomous vehicles.

Acceleration Method for Hazardous Scenario Generation Based on Disengagement Cases

Scenario Generation for Autonomous Vehicles with Deep-Learning-Based Heterogeneous Driver Models: Implementation and Verification

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

Study on the Impacts of Hazardous Behaviors on Autonomous Vehicle Collision Rates Based on Humanoid Scenario Generation in CARLA

Generating Critical Scenarios for Testing Automated Driving Systems

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Bridging Data-Driven and Knowledge-Driven Approaches for Safety-Critical Scenario Generation in Automated Vehicle Validation

Online Adaptive Generation of Critical Boundary Scenarios for Evaluation of Autonomous Vehicles

Exploring master scenarios for autonomous driving tests from police-reported historical crash data using an adaptive search sampling framework

Multi-Agent Vulnerability Discovery for Autonomous Driving with Hazard Arbitration Reward

Dynamic Testing for Autonomous Vehicles Using Random Quasi Monte Carlo

Multi-Agent Vulnerability Discovery for Autonomous Driving Policy by Finding AV-Responsible Scenarios

An Accelerated Safety Assessment Method for Control Policies of Autonomous Vehicles in Open Environments

Genetic Algorithm-Based Challenging Scenarios Generation for Autonomous Vehicle Testing

A Quantitative Approach of Generating Challenging Testing Scenarios Based on Functional Safety Standard

Quantitative Representation of Scenario Difficulty for Autonomous Driving Based on Adversarial Policy Search

Generating Edge Cases for Testing Autonomous Vehicles Using Real-World Data

Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehicles

Automated and Complete Generation of Traffic Scenarios at Road Junctions Using a Multi-level Danger Definition

High-risk powered two-wheelers scenarios generation for autonomous vehicle testing using WGAN

A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspective