Abstract:We present a framework for merging unit tests for autonomous systems. Typically, it is intractable to test an autonomous system for every scenario in its operating environment. The question of whether it is possible to design a single test for multiple requirements of the system motivates this work. First, we formally define three attributes of a test: a test specification that characterizes behaviors observed in a test execution, a test environment, and a test policy. Using the merge operator from contract-based design theory, we provide a formalism to construct a merged test specification from two unit test specifications. Temporal constraints on the merged test specification guarantee that non-trivial satisfaction of both unit test specifications is necessary for a successful merged test execution. We assume that the test environment remains the same across the unit tests and the merged test. Given a test specification and a test environment, we synthesize a test policy filter using a receding horizon approach, and use the test policy filter to guide a search procedure (e.g. Monte-Carlo Tree Search) to find a test policy that is guaranteed to satisfy the test specification. This search procedure finds a test policy that maximizes a pre-defined robustness metric for the test while the filter guarantees a test policy for satisfying the test specification. We prove that our algorithm is sound. Furthermore, the receding horizon approach to synthesizing the filter ensures that our algorithm is scalable. Finally, we show that merging unit tests is impactful for designing efficient test campaigns to achieve similar levels of coverage in fewer test executions. We illustrate our framework on two self-driving examples in a discrete-state setting.

EUnit: A Unit Testing Framework for Model Management Tasks

ETC-Based Methodology on Data Processing Validation

Network Management Interface Automatic Testing Framework Based on Model-Driven

A Framework of Model-Driven Web Application Testing

UniTest: A Universal Testing Framework for Database Management Systems

Novel Collaborative Automated Testing Framework Using Ddf

Towards a Framework for Differential Unit Testing of Object-Oriented Programs.

A Metamodel of Unit Testing for Object-Oriented Programming Languages

ChatUniTest: A Framework for LLM-Based Test Generation

BPEL-Unit: JUnit for BPEL Processes

Design and implementation of model repository testing based on metamodel and JUnit

Towards a Complete Metamorphic Testing Pipeline

Towards Better Test Coverage: Merging Unit Tests for Autonomous Systems

Enabling Unit Proofing for Software Implementation Verification

Tool-assisted Unit-Test Generation and Selection Based on Operational Abstractions

Formalizing the ISO/IEC/IEEE 29119 Software Testing Standard

Verification and Validation Test Framework Using a Model‐Based Systems Engineering Approach

A Uml-Based Environment For Software Testing And Verification

TUnit - Unit Testing For Template-based Code Generators

Extensible Validation Framework for DSLs using MontiCore on the Example of Coding Guidelines

Federate Automated Testing System Based On Markov Chain Usage Model