Abstract:Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefined or scripted BVs, which inadequately reflect the complexity of human-like social behaviors in real-world driving scenarios, and also lack a systematic metric for evaluating the comprehensive intelligence of AVs. Therefore, this paper proposes an evolving scenario generation method that utilizes deep reinforcement learning (DRL) to create human-like BVs for testing and intelligence evaluation of AVs. Firstly, a class of driver models with human-like competitive, cooperative, and mutual driving motivations is designed. Then, utilizing an improved "level-k" training procedure, the three distinct driver models acquire game-based interactive driving policies. And these models are assigned to BVs for generating evolving scenarios in which all BVs can interact continuously and evolve diverse contents. Next, a framework including safety, driving efficiency, and interaction utility are presented to evaluate and quantify the intelligence performance of 3 systems under test (SUTs), indicating the effectiveness of the evolving scenario for intelligence testing. Finally, the complexity and fidelity of the proposed evolving testing scenario are validated. The results demonstrate that the proposed evolving scenario exhibits the highest level of complexity compared to other baseline scenarios and has more than 85% similarity to naturalistic driving data. This highlights the potential of the proposed method to facilitate the development and evaluation of high-level AVs in a realistic and challenging environment.

Verification and Validation Methods for Decision-Making and Planning of Automated Vehicles: A Review

Automated Vehicle-Involved Traffic Flow Studies: A Survey of Assumptions, Models, Speculations, and Perspectives

A taxonomy of validation strategies to ensure the safe operation of highly automated vehicles

Integrating Formal Verification and Simulation-based Assertion Checking in a Corroborative V&V Process

Hybrid Verification Technique for Decision-Making of Self-Driving Vehicles

Formal Certification Methods for Automated Vehicle Safety Assessment

Autonomous Vehicles Testing Considering Utility-Based Operable Tasks

A systematic review of safety-critical scenarios between automated vehicles and vulnerable road users

An Evaluation Method for Automated Vehicles Combining Subjective and Objective Factors

Safe and Adaptive Decision Algorithm of Automated Vehicle for Unsignalized Intersection Driving

Decision-Making Driven by Driver Intelligence and Environment Reasoning for High-Level Autonomous Vehicles: A Survey

An Interaction-aware Evaluation Method for Highly Automated Vehicles

Efficient falsification approach for autonomous vehicle validation using a parameter optimisation technique based on reinforcement learning

Coverage based testing for V&V and Safety Assurance of Self-driving Autonomous Vehicles: A Systematic Literature Review

Autonomous Vehicle Decision-Making and Control in Complex and Unconventional Scenarios—A Review

Review of Decision-Making and Planning Approaches in Automated Driving

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

Modeling Methodology of Driver-Vehicle-Environment System Dynamics in Mixed Driving Situation

Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control Systems

Comparison of the HAZOP, FMEA, FRAM, and STPA Methods for the Hazard Analysis of Automatic Emergency Brake Systems

Paving the Roadway for Safety of Automated Vehicles: An Empirical Study on Testing Challenges