Abstract:Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefined or scripted BVs, which inadequately reflect the complexity of human-like social behaviors in real-world driving scenarios, and also lack a systematic metric for evaluating the comprehensive intelligence of AVs. Therefore, this paper proposes an evolving scenario generation method, employing deep reinforcement learning (DRL) to construct human-like BVs that interact with AVs, and this evolving scenario is designed to test and evaluate the intelligence of AVs. Firstly, a class of BV driver models with human-like competitive, mutual, and cooperative driving motivations is designed. Then, utilizing the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm and an improved level-k training procedure, the three distinct driver models acquire game-based interactive driving policies. And these driver models are combined to generate evolving scenarios in which they can interact continuously and evolve diverse contents. Next, a framework including safety, driving efficiency, and interaction utility are presented to evaluate and quantify the intelligence performance of 3 systems under test (SUTs), indicating the effectiveness of the evolving scenario for intelligence testing. Finally, the complexity and fidelity of the proposed evolving testing scenario are validated. The results demonstrate that the proposed evolving scenario exhibits the highest level of complexity compared to other baseline scenarios and has more than 85% similarity to naturalistic driving data. This highlights the potential of the proposed method to facilitate the development and evaluation of high-level AVs in a realistic and challenging environment.

Adaptive Deep Reinforcement Learning for Critical Boundary Scenario Generation

Online Adaptive Generation of Critical Boundary Scenarios for Evaluation of Autonomous Vehicles

Interactive Critical Scenario Generation for Autonomous Vehicles Testing Based on In-depth Crash Data Using Reinforcement Learning

Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning

Evolving testing scenario generation and intelligence evaluation for automated vehicles

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Enhancing Autonomous Lane-Changing Safety: Deep Reinforcement Learning Via Pre-Exploration in Parallel Imaginary Environments

CRASH: Challenging Reinforcement-Learning Based Adversarial Scenarios For Safety Hardening

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

Dense reinforcement learning for safety validation of autonomous vehicles

Autonomous Highway Driving using Deep Reinforcement Learning

An Integrated Framework of Lateral and Longitudinal Behavior Decision-Making for Autonomous Driving Using Reinforcement Learning

Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning

Deep Reinforcement Learning for Adverse Garage Scenario Generation

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Critical Scenario Generation for Realistic Testing of Autonomous Driving System Via Multi-vehicle Cooperative Control

A Rear Anti-Collision Decision-Making Methodology Based on Deep Reinforcement Learning for Autonomous Commercial Vehicles

Continuous Decision-Making in Lane Changing and Overtaking Maneuvers for Unmanned Vehicles: A Risk-Aware Reinforcement Learning Approach with Task Decomposition