Abstract:Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefined or scripted BVs, which inadequately reflect the complexity of human-like social behaviors in real-world driving scenarios, and also lack a systematic metric for evaluating the comprehensive intelligence of AVs. Therefore, this paper proposes an evolving scenario generation method that utilizes deep reinforcement learning (DRL) to create human-like BVs for testing and intelligence evaluation of AVs. Firstly, a class of driver models with human-like competitive, cooperative, and mutual driving motivations is designed. Then, utilizing an improved "level-k" training procedure, the three distinct driver models acquire game-based interactive driving policies. And these models are assigned to BVs for generating evolving scenarios in which all BVs can interact continuously and evolve diverse contents. Next, a framework including safety, driving efficiency, and interaction utility are presented to evaluate and quantify the intelligence performance of 3 systems under test (SUTs), indicating the effectiveness of the evolving scenario for intelligence testing. Finally, the complexity and fidelity of the proposed evolving testing scenario are validated. The results demonstrate that the proposed evolving scenario exhibits the highest level of complexity compared to other baseline scenarios and has more than 85% similarity to naturalistic driving data. This highlights the potential of the proposed method to facilitate the development and evaluation of high-level AVs in a realistic and challenging environment.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in scenario - based autonomous vehicle (AVs) testing, the interaction between background vehicles (BVs) and autonomous vehicles is crucial for evaluating the intelligence of AVs. However, current test scenarios usually adopt predefined or scripted BVs, which cannot fully reflect the complex human social behaviors in real - driving scenarios and lack systematic indicators to comprehensively evaluate the intelligence of AVs. Specifically, the paper points out the following limitations of predefined scenarios: 1. The traffic environment is mainly based on pre - written, fragmented driving scenarios, in which the actions of traffic participants are preset, resulting in a single - type generated simulation environment and may reduce the effectiveness of the test. 2. The lack of human - like social driving strategies may lead to unrealistic interactions and poor playability between BVs and SUTs. 3. Predefined scenarios are usually for specific test targets and are difficult to be used for multi - target tests. Since the intelligence of SUTs consists of multiple indicators, it is difficult to meet the intelligence - oriented test requirements based on predefined scenarios. To solve these problems, the paper proposes an evolutionary scenario generation method based on deep reinforcement learning (DRL) to create BVs with human - driving characteristics, so as to conduct more realistic intelligence tests of AVs. The main contributions of this method include: 1. A class of human - driving models with competitive, cooperative and reciprocal driving motives is designed, and game - based interactive driving strategies are obtained through an improved "level - k" training procedure. 2. A set of quantitative evaluation frameworks including safety, driving efficiency and interaction utility is proposed to evaluate the intelligent performance of different systems under test (SUTs) in evolutionary test scenarios. 3. Through the design of the reward function, the driving model is equipped with competitive, reciprocal and cooperative game - like driving strategies. 4. A comprehensive verification and comparison of the generated evolutionary test scenarios are carried out, which proves their complexity and authenticity. In conclusion, this research aims to improve the efficiency, complexity and authenticity of test scenarios and provide a comprehensive evaluation framework to measure the SUT's ability to adapt decisions and actions in an interactive environment.

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

Evolving testing scenario generation and intelligence evaluation for automated vehicles

Online Adaptive Generation of Critical Boundary Scenarios for Evaluation of Autonomous Vehicles

Automated Scenario Generation and Iterative Regression Testing Method for Autonomous Driving Systems

Generating Edge Cases for Testing Autonomous Vehicles Using Real-World Data

Scenario Generation for Autonomous Vehicles with Deep-Learning-Based Heterogeneous Driver Models: Implementation and Verification

Autonomous Vehicles Testing Considering Utility-Based Operable Tasks

scenoRITA: Generating Less-Redundant, Safety-Critical and Motion Sickness-Inducing Scenarios for Autonomous Vehicles

Generating Critical Scenarios for Testing Automated Driving Systems

Adaptive Deep Reinforcement Learning for Critical Boundary Scenario Generation

Life-long Learning and Testing for Automated Vehicles via Adaptive Scenario Sampling as A Continuous Optimization Process

Game-Theoretic Adversarial Interaction-Based Critical Scenario Generation for Autonomous Vehicles

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning

Multimodal Large Language Model Driven Scenario Testing for Autonomous Vehicles

An Interaction-aware Evaluation Method for Highly Automated Vehicles

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing

Scalable Evaluation Methods for Autonomous Vehicles

A Scenario-Based Development Framework for Autonomous Driving