Abstract:Context: Ontologies are known as a formal and explicit conceptualization of entities, their interfaces, behaviors, and relationships. They have been applied in various application domains such as autonomous driving where ontologies are used for decision making, traffic description, auto-pilot etc. It has always been a challenge to test the corresponding safety-critical software systems in autonomous driving that have been playing an increasingly important role in our daily routines.Objective: Failures in these systems potentially not only cause great financial loss but also the loss of lives. Therefore, it is vital to obtain and cover as many as critical driving scenarios during auto drive testing to ensure that the system can always reach a fail-safe state under different circumstances.Method: We outline a general framework for testing, verification, and validation for automated and autonomous driving functions. The introduced method makes use of ontologies for describing the environment of autonomous vehicles and convert them to input models for combinatorial testing. The combinatorial test suite comprises abstract test cases that are mapped to concrete test cases that can be executed using simulation environments.Results: We discuss in detail on how to automatically convert ontologies to the corresponding combinatorial testing input models. Specifically, we present two conversion algorithms and compare their applicability using ontologies with different sizes. We also carried out a case study to further demonstrate the practical value of applying ontology-based test generation in industrial settings.Conclusion: The proposed approach for testing autonomous driving takes ontologies describing the environment of autonomous vehicles, and automatically converts it to test cases that are used in a simulation environment to verify automated driving functions. The conversion relies on combinatorial testing. The first experimental results relying on an example from the automotive industry indicates that the approach can be used in practice.

Test scenario generation method for autonomous vehicles based on combinatorial testing and Bayesian network

Test Scenario Generation and Optimization Technology for Intelligent Driving Systems

A Test Scenario Automatic Generation Strategy for Intelligent Driving Systems

Genetic Algorithm-Based Challenging Scenarios Generation for Autonomous Vehicle Testing

Test Scenario Design for Intelligent Driving System Ensuring Coverage and Effectiveness

Automatic Generation of Intelligent Vehicle Testing Scenarios at Intersections Based on Natural Driving Datasets

Risk Scenario Generation for Autonomous Driving Systems based on Causal Bayesian Networks

Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology

Automated Scenario Generation and Iterative Regression Testing Method for Autonomous Driving Systems

Task-Driven Controllable Scenario Generation Framework Based on AOG

Ontology-based test generation for automated and autonomous driving functions

A Quantitative Approach of Generating Challenging Testing Scenarios Based on Functional Safety Standard

Intersection Two-Vehicle Crash Scenario Specification for Automated Vehicle Safety Evaluation Using Sequence Analysis and Bayesian Networks

Functional Testing Scenario Library Generation Framework for Connected and Automated Vehicles

Automatic Virtual Test Technology for Intelligent Driving Systems Considering Both Coverage and Efficiency

A Needle in a Haystack -- How to Derive Relevant Scenarios for Testing Automated Driving Systems in Urban Areas

RoadGen: Generating Road Scenarios for Autonomous Vehicle Testing

Restricted Natural Language and Model-based Adaptive Test Generation for Autonomous Driving

TraModeAVTest: Modeling Scenario and Violation Testing for Autonomous Driving Systems Based on Traffic Regulations