Abstract:Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the long-tailed distribution, sparsity, and rarity in real-world data sets. To tackle this problem, in this paper, we introduce a natural adversarial scenario generation solution using naturalistic human driving priors and reinforcement learning techniques. By doing this, we can obtain large-scale test scenarios that are both diverse and realistic. Specifically, we build a simulation environment that mimics natural traffic interaction scenarios. Informed by this environment, we implement a two-stage procedure. The first stage incorporates conventional rule-based models, e.g., IDM~(Intelligent Driver Model) and MOBIL~(Minimizing Overall Braking Induced by Lane changes) model, to coarsely and discretely capture and calibrate key control parameters from the real-world dataset. Next, we leverage GAIL~(Generative Adversarial Imitation Learning) to represent driver behaviors continuously. The derived GAIL can be further used to design a PPO~(Proximal Policy Optimization)-based actor-critic network framework to fine-tune the reward function, and then optimizes our natural adversarial scenario generation solution. Extensive experiments have been conducted in the NGSIM dataset including the trajectory of 3,000 vehicles. Essential traffic parameters were measured in comparison with the baseline model, e.g., the collision rate, accelerations, steering, and the number of lane changes. Our findings demonstrate that the proposed model can generate realistic safety-critical test scenarios covering both naturalness and adversariality, which can be a cornerstone for the development of autonomous vehicles.

Efficient Generation of Safety-Critical Scenarios Combining Dynamic and Static Scenario Parameters

Double Counterfactual Regret Minimization for Generating Safety-Critical Scenario of Autonomous Driving

A Survey on Safety-Critical Driving Scenario Generation—A Methodological Perspective

A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspective

Bridging Data-Driven and Knowledge-Driven Approaches for Safety-Critical Scenario Generation in Automated Vehicle Validation

Hazardous Scenario Enhanced Generation for Automated Vehicle Testing Based on Optimization Searching Method

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Multimodal Safety-Critical Scenarios Generation for Decision-Making Algorithms Evaluation

Efficient Precision-Driven Scenario Design: Tailoring Collision Type Probabilities for Richer Autonomous Testing

Acceleration Method for Hazardous Scenario Generation Based on Disengagement Cases

Generation of a scenario library for testing driver-automation cooperation safety under cut-in working conditions

A Real-time Critical-scenario-generation Framework for Testing Autonomous Driving System

Game-Theoretic Adversarial Interaction-Based Critical Scenario Generation for Autonomous Vehicles

Online Adaptive Generation of Critical Boundary Scenarios for Evaluation of Autonomous Vehicles

Interactive Critical Scenario Generation for Autonomous Vehicles Testing Based on In-depth Crash Data Using Reinforcement Learning

Acquire Driving Scenarios Efficiently: A Framework for Prospective Assessment of Cost-Optimal Scenario Acquisition

ReGentS: Real-World Safety-Critical Driving Scenario Generation Made Stable

Scenario Parameter Generation Method and Scenario Representativeness Metric for Scenario-Based Assessment of Automated Vehicles

EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing

Integrated Scenario-based Analysis: A data-driven approach to support automated driving systems development and safety evaluation

Critical Scenarios Based on Graded Hazard Disposal Model of Human Drivers