Abstract:To assess test quality in timed safety‐critical systems modeled as Timed Automata, we present MUPPAAL, a mutation testing framework that detects and removes useless mutants (equivalent and duplicates). By integrating scalable bisimulation algorithms and fast approximate checks through biased simulation, MUPPAAL reduces the impact of duplicates, which can account for up to 32% of generated mutants. We evaluate MUPPAAL on six systems, showing it achieves up to ten times faster performance while effectively minimizing unnecessary mutant exploration. To assess test quality, mutation testing (MT) creates mutants by injecting artificial faults into the system and evaluates the ability of tests to distinguish these mutants. Tests distinguishing more mutants have also been proven empirically to detect more real faults. MT has been applied to many domains. We focus on MT for timed safety‐critical systems modelled as Timed Automata (TA). While powerful, MT usually yields equivalent and duplicate mutants, the former having the same behaviour as the original system and the latter other mutants. Such useless mutants bring no value, waste execution time and can be difficult to detect. We integrate useless mutant detection and removal strategies in our mutation framework MUPPAAL. MUPPAAL leverages existing equivalence‐avoiding mutation operators and focuses on detecting mutant duplicates using a scalable bisimulation algorithm and a fast approximate one based on biased simulation. We also demonstrate how to design an operator that reduces the occurrence of mutant duplicates. We evaluate MUPPAAL on six systems, demonstrating that (1) mutant duplicates account for up to 32% of all generated mutants, (2) our bisimulation approach scales effectively with these systems and (3) biased simulations further enhance performance. Our heuristic is 10 times faster than bisimulation and limits the exploration to two times the number of exact duplicates compared to up to 10 times for the baseline.

Muskit: a Mutation Analysis Tool for Quantum Software Testing

Which Quantum Circuit Mutants Shall Be Used? An Empirical Evaluation of Quantum Circuit Mutations

QCRMut: Quantum Circuit Random Mutant generator tool

Mutation-based Test Generation for Quantum Programs with Multi-Objective Search

MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform

QuSBT: Search-Based Testing of Quantum Programs

Quito - a Coverage-Guided Test Generator for Quantum Programs.

QuCAT: A Combinatorial Testing Tool for Quantum Software

MQP: Mutants Quality Prediction for Cost-Effective Mutation Testing

MQT Qudits: A Software Framework for Mixed-Dimensional Quantum Computing

MOTIF: A tool for Mutation Testing with Fuzzing

MQT Predictor: Automatic Device Selection with Device-Specific Circuit Compilation for Quantum Computing

QASMBench: A Low-level QASM Benchmark Suite for NISQ Evaluation and Simulation

Assessing the Effectiveness of Input and Output Coverage Criteria for Testing Quantum Programs

SN4KE: Practical Mutation Testing at Binary Level

Analyzing Quantum Programs with LintQ: A Static Analysis Framework for Qiskit

A Survey on Testing and Analysis of Quantum Software

MUPPAAL: Efficient Elimination and Reduction of Useless Mutants in Real‐Time Model‐Based Systems

MuSC: A Tool for Mutation Testing of Ethereum Smart Contract

Heuristics for Strongly Killing Mutants in Software Mutation Testing

MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing