Abstract:To meet the requirements of scenario-based testing for Autonomous Vehicles (AVs), driving scenario characterization has become a critical issue. Existing studies have concluded that complexity is a necessary criticality measure for supporting critical AV testing scenario identification. However, the existing scenario complexity quantification studies mainly have two limitations, namely, subjective quantification methods highly rely on human participations and are difficult to apply to big data, and existing objective methods lack consideration of human driver characteristics and hence the performance cannot be guaranteed. To bridge these research gaps, a general objective quantification framework is proposed to quantify human drivers' judgement on driving environment complexity, by describing the vehicle-vehicle spatial-temporal interactions from the perspectives of quantity, variety, and relations. The model mainly contains three parts. First, to describe quantity information, a dynamic influencing area was set to identify the surrounding vehicles that contribute to driving environment complexity based on ResponsibilitySensitive Safety (RSS) theory. Second, considering the various surrounding vehicles' driving statuses, behaviors, and intentions, a basic vehicle-pair complexity quantification model was constructed based on encounter angles. Then, nonlinear relationships based upon information entropy theory were introduced to capture the heterogeneous longitudinal and lateral complexities. Third, a vehicle-pair complexity aggregation and smoothing step was conducted to reflect the characteristics of human driver's cognition. To demonstrate the abovementioned model, empirical Field Operational Test (FOT) data from Shanghai urban roadways were used to conduct case studies, and it can be concluded that this model can accurately describe the timing and extent of the complexity change, and reveal the complexity differences due to scenario type and spatial-temporal heterogeneity. Besides, Inter-Rater Reliability (IRR) index was calculated to validate the consistency of scenario complexity judgement between the proposed model and human drivers, and for performance comparison with the existing models. Finally, the applications of the proposed model and its further investigations have been discussed.

Guidelines for evaluation of complex multi agent test scenarios

Simulation Assessment Guidelines towards Independent Safety Assurance of Autonomous Vehicles

Scenario-Based Safety Assessment Framework for Automated Vehicles

Behaviour Description Database for AVs in Singapore

Online Adaptive Generation of Critical Boundary Scenarios for Evaluation of Autonomous Vehicles

Dynamic Driving Environment Complexity Quantification Method and Its Verification

Tagging Real-World Scenarios for the Assessment of Autonomous Vehicles

An Evaluation Method for Automated Vehicles Combining Subjective and Objective Factors

Procedure for the Safety Assessment of an Autonomous Vehicle Using Real-World Scenarios

Scalable Evaluation Methods for Autonomous Vehicles

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

Evaluation method with digital expert on the criticality of car-following scenarios for autonomous vehicles testing

Autonomous Vehicles Testing Considering Utility-Based Operable Tasks

The Implementation of Safety Acceptance Evaluation for Highly Automated Vehicles

A taxonomy of validation strategies to ensure the safe operation of highly automated vehicles

Automated and Complete Generation of Traffic Scenarios at Road Junctions Using a Multi-level Danger Definition

Evolving testing scenario generation and intelligence evaluation for automated vehicles

Generating Critical Scenarios for Testing Automated Driving Systems

Traffic Sensory Data Classification by Quantifying Scenario Complexity.

Safety performance evaluation of freeway merging areas under autonomous vehicles environment using a co-simulation platform

Determining the Tactical Challenge of Scenarios to Efficiently Test Automated Driving Systems