Abstract:Scenario based methods for testing and validation of automated driving systems in virtual test environments are gaining importance and becoming an important component for verification and validation processes of automated driving systems. The high system complexity of such systems and the high testing costs lead to an exponential increase of test efforts for real world testing. Recent research works have shown that it is necessary to drive and test billions of kilometers to ensure the safety and reliability of automated driving systems. This amount of test kilometers is far from possible and achievable for any test procedure regarding the time and costs. Using different methods and procedures it is possible to reduce the number of scenarios, which should be tested to approve the safety and reliability of automated driving systems. The scenario space consisting of critical and non-critical scenarios and the test effort can be reduced to an infinite and comprehensible amount of relevant scenarios for the system under test. Using scenario and simulation based approaches this effort can be efficiently reduced concerning the costs and time. The biggest challenges hereby are the detection and selection of a suitable scenarios and simulation environments or platforms for the system under test. Besides, suitable safety metrics are essential for the detection, evaluation, and reduction of relevant scenarios for testing of automated driving systems. Current scientific work offers various strategies and approaches for generating relevant scenarios for automated driving systems. All of them have their advantages and disadvantages related to the used virtual environment, vehicle model, traffic model, and the integration complexity. This paper presents a survey through different approaches, methods, and safety metrics for scenario generation and evaluation for testing and validation of automated driving systems. The reader should get a state of the art overview on scenario based approaches of automated driving systems.

Scenario Based Testing of Automated Driving Systems: A Literature Survey

A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulation

Finding Critical Scenarios for Automated Driving Systems: A Systematic Mapping Study

Holistic Driving Scenario Concept for Urban Traffic

1001 Ways of Scenario Generation for Testing of Self-driving Cars: A Survey

A Survey on Data-Driven Scenario Generation for Automated Vehicle Testing

A Credibility Assessment Approach for Scenario-Based Virtual Testing of Automated Driving Functions

A Needle in a Haystack -- How to Derive Relevant Scenarios for Testing Automated Driving Systems in Urban Areas

Acquire Driving Scenarios Efficiently: A Framework for Prospective Assessment of Cost-Optimal Scenario Acquisition

Stress Testing Method for Scenario Based Testing of Automated Driving Systems

A Scenario-Based Development Framework for Autonomous Driving

Literature Review on Maneuver-Based Scenario Description for Automated Driving Simulations

Integrated Scenario-based Analysis: A data-driven approach to support automated driving systems development and safety evaluation

Generating Critical Scenarios for Testing Automated Driving Systems

A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspective

A Survey on Safety-Critical Driving Scenario Generation—A Methodological Perspective

Specification-Guided Critical Scenario Identification for Automated Driving

Determining the Tactical Challenge of Scenarios to Efficiently Test Automated Driving Systems

A taxonomy of validation strategies to ensure the safe operation of highly automated vehicles

Automated Scenario Generation and Iterative Regression Testing Method for Autonomous Driving Systems

Learning Critical Scenarios in Feedback Control Systems for Automated Driving