Abstract:Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the long-tailed distribution, sparsity, and rarity in real-world data sets. To tackle this problem, in this paper, we introduce a natural adversarial scenario generation solution using naturalistic human driving priors and reinforcement learning techniques. By doing this, we can obtain large-scale test scenarios that are both diverse and realistic. Specifically, we build a simulation environment that mimics natural traffic interaction scenarios. Informed by this environment, we implement a two-stage procedure. The first stage incorporates conventional rule-based models, e.g., IDM~(Intelligent Driver Model) and MOBIL~(Minimizing Overall Braking Induced by Lane changes) model, to coarsely and discretely capture and calibrate key control parameters from the real-world dataset. Next, we leverage GAIL~(Generative Adversarial Imitation Learning) to represent driver behaviors continuously. The derived GAIL can be further used to design a PPO~(Proximal Policy Optimization)-based actor-critic network framework to fine-tune the reward function, and then optimizes our natural adversarial scenario generation solution. Extensive experiments have been conducted in the NGSIM dataset including the trajectory of 3,000 vehicles. Essential traffic parameters were measured in comparison with the baseline model, e.g., the collision rate, accelerations, steering, and the number of lane changes. Our findings demonstrate that the proposed model can generate realistic safety-critical test scenarios covering both naturalness and adversariality, which can be a cornerstone for the development of autonomous vehicles.

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Adversarial Evaluation of Autonomous Vehicles in Lane-Change Scenarios

Game-Theoretic Adversarial Interaction-Based Critical Scenario Generation for Autonomous Vehicles

Vehicle Lane-Changing scenario generation using time-series generative adversarial networks with an Adaptative parameter optimization strategy

CRASH: Challenging Reinforcement-Learning Based Adversarial Scenarios For Safety Hardening

Interactive Critical Scenario Generation for Autonomous Vehicles Testing Based on In-depth Crash Data Using Reinforcement Learning

Adaptive Deep Reinforcement Learning for Critical Boundary Scenario Generation

Adversarial Driving Behavior Generation Incorporating Human Risk Cognition for Autonomous Vehicle Evaluation

AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles

A Hazardous Lane-Changing Scenario Search Approach Based on Adaptive Random Testing for Automated Vehicles

LMM-enhanced Safety-Critical Scenario Generation for Autonomous Driving System Testing From Non-Accident Traffic Videos

Closed-Loop Simulation Test Method for Autonomous Vehicles Based on Adversarial Scenarios

Training Adversarial yet Safe Agent to Characterize Safety Performance of Highly Automated Vehicles

Generating Critical Scenarios for Testing Automated Driving Systems

Critical Scenario Generation for Realistic Testing of Autonomous Driving System Via Multi-vehicle Cooperative Control

Automated and Complete Generation of Traffic Scenarios at Road Junctions Using a Multi-level Danger Definition

A Dynamic Test Scenario Generation Method for Autonomous Vehicles Based on Conditional Generative Adversarial Imitation Learning

Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehicles

Rapid Generation of Challenging Simulation Scenarios for Autonomous Vehicles Based on Adversarial Test

Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning