Abstract:Context: Ontologies are known as a formal and explicit conceptualization of entities, their interfaces, behaviors, and relationships. They have been applied in various application domains such as autonomous driving where ontologies are used for decision making, traffic description, auto-pilot etc. It has always been a challenge to test the corresponding safety-critical software systems in autonomous driving that have been playing an increasingly important role in our daily routines.Objective: Failures in these systems potentially not only cause great financial loss but also the loss of lives. Therefore, it is vital to obtain and cover as many as critical driving scenarios during auto drive testing to ensure that the system can always reach a fail-safe state under different circumstances.Method: We outline a general framework for testing, verification, and validation for automated and autonomous driving functions. The introduced method makes use of ontologies for describing the environment of autonomous vehicles and convert them to input models for combinatorial testing. The combinatorial test suite comprises abstract test cases that are mapped to concrete test cases that can be executed using simulation environments.Results: We discuss in detail on how to automatically convert ontologies to the corresponding combinatorial testing input models. Specifically, we present two conversion algorithms and compare their applicability using ontologies with different sizes. We also carried out a case study to further demonstrate the practical value of applying ontology-based test generation in industrial settings.Conclusion: The proposed approach for testing autonomous driving takes ontologies describing the environment of autonomous vehicles, and automatically converts it to test cases that are used in a simulation environment to verify automated driving functions. The conversion relies on combinatorial testing. The first experimental results relying on an example from the automotive industry indicates that the approach can be used in practice.

ISTA +: Test Case Generation and Optimization for Intelligent Systems Based on Coverage Analysis

Effective code coverage in compositional systematic dynamic testing

Test Scenario Design for Intelligent Driving System Ensuring Coverage and Effectiveness

Top-down: A better strategy for incremental covering array generation

An Automated Test Generation Technique for Software Quality Assurance

AI-Compass: A Comprehensive and Effective Multi-module Testing Tool for AI Systems

A Tool for Automatic Service Interface Testing

A Systematic and Semi-Automatic Safety-Based Test Case Generation Approach Based on Systems-Theoretic Process Analysis

A Test Scenario Automatic Generation Strategy for Intelligent Driving Systems

Auto-generation and redundancy reduction of test cases for reactive systems

Automatic Virtual Test Technology for Intelligent Driving Systems Considering Both Coverage and Efficiency

Coverage Goal Selector for Combining Multiple Criteria in Search-Based Unit Test Generation

Coverage Explorer: Coverage-guided Test Generation for Cyber Physical Systems

Ontology-based test generation for automated and autonomous driving functions

Asit: an Interface-oriented Distributed Automated Test System

Automated Test Case Generation for Embedded Software Using Extended Interface Automata

SmartUnit: Empirical Evaluations for Automated Unit Testing of Embedded Software in Industry

Computer Vision Intelligence Test Modeling and Generation: A Case Study on Smart OCR

What You See Is What You Get: Attention-based Self-guided Automatic Unit Test Generation

Static Code Analysis in the AI Era: An In-depth Exploration of the Concept, Function, and Potential of Intelligent Code Analysis Agents