Abstract:While there was great progress regarding the technology and its implementation for vehicles equipped with automated driving systems (ADS), the problem of how to proof their safety as a necessary precondition prior to market launch remains unsolved. One promising solution are scenario-based test approaches; however, there is no commonly accepted way of how to systematically generate and extract the set of relevant scenarios to be tested to sufficiently capture the real-world traffic dynamics, especially for urban operational design domains. Within the scope of this paper, the overall concept of a novel simulation-based toolchain for the development and testing of ADS-equipped vehicles in urban environments is presented. Based on previous work regarding highway environments, the developed novel enhancements aim at empowering the toolchain to be able to deal with the increased complexity due to the more complex road networks with multi-modal interactions of various traffic participants. Based on derived requirements, a thorough explanation of different modules constituting the toolchain is given, showing first results and identified research gaps, respectively. A closer look is taken on two use cases: First, it is investigated whether the toolchain is capable to serve as synthetic data source within the development phase of ADS-equipped vehicles to enrich a scenario database in terms of extent, complexity and impacts of different what-if-scenarios for future mixed traffic. Second, it is analyzed how to combine the individual advantages of real recorded data and an agent-based simulation within a so-called adaptive replay-to-sim approach to support the testing phase of an ADS-equipped vehicle. The developed toolchain contributes to the overarching goal of a commonly accepted methodology for the validation and safety proof of ADS-equipped vehicles, especially in urban environments.

A Roadmap for Simulation-Based Testing of Autonomous Cyber-Physical Systems: Challenges and Future Direction

Rigorous Simulation-based Testing for Autonomous Driving Systems -- Targeting the Achilles' Heel of Four Open Autopilots

Approaching the Automation of Cyber Security Testing of Connected Vehicles

Scenario-based Accelerated Testing for SOTIF in Autonomous Driving: A Review

Paving the Roadway for Safety of Automated Vehicles: An Empirical Study on Testing Challenges

Coupled Requirements-driven Testing of CPS: From Simulation To Reality

Exiting the Simulation: The Road to Robust and Resilient Autonomous Vehicles at Scale

Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components

Concepts in Testing of Autonomous Systems: Academic Literature and Industry Practice

Formal Scenario-Based Testing of Autonomous Vehicles: From Simulation to the Real World

Testing of Autonomous Driving Systems: Where Are We and Where Should We Go?

A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulation

Rapid Generation of Challenging Simulation Scenarios for Autonomous Vehicles Based on Adversarial Test

A Needle in a Haystack -- How to Derive Relevant Scenarios for Testing Automated Driving Systems in Urban Areas

Addressing the IEEE AV Test Challenge with Scenic and VerifAI

Paracosm: A Test Framework for Autonomous Driving Simulations

Exploring the Boundaries: Thorough Software Testing for Safety-Critical Driving Scenarios Based on Kinematics in the Context of Autonomous Driving

Generating Edge Cases for Testing Autonomous Vehicles Using Real-World Data

Challenges in Developing Software for Cyber-Physical Systems

I came, I saw, I certified: some perspectives on the safety assurance of cyber-physical systems

From Model-Based to Data-Driven Simulation: Challenges and Trends in Autonomous Driving