Abstract:The capability of Quantum Computing (QC) in solving complex problems has been increasingly recognized. However, similar to classical computing, to fully exploit QC's potential, it is important to ensure the correctness of quantum programs. Doing so via software testing is, however, very challenging because of QC's inherent properties: superposition and entanglement. Towards the direction of ensuring the correctness of quantum programs, we propose an approach called QuCAT (QUantum CombinAtorial Testing) for systematic and automated testing of quantum programs by benefiting from combinatorial testing, which has been proven to be cost-effective in testing classical programs. QuCAT supports two combinatorial test suite generation scenarios, i.e., generating combinatorial test suites of a given strength, and incrementally generating and executing combinatorial test suites of increasing strength until a fault is found. The approach employs two types of test oracles to assess test results. We performed an empirical study with 18 faulty versions of quantum programs to evaluate QuCAT with strengths of two, three, and four in the two test generation scenarios. We compare the cost-effectiveness of combinatorial testing of various strengths and random testing (taken as baseline approach). Results show that combinatorial testing always performs better than random testing with the same cost and finds faults more quickly (in terms of required number of test cases). In addition, in most cases, combinatorial testing with a higher strength outperforms the lower strength in terms of effectiveness.

Concurrent Test Algebra Execution with Combinatorial Testing

Test Algebra for Combinatorial Testing

Adaptive Fault Detection for Testing Tenant Applications in Multi-tenancy SaaS Systems

A self-adaptive test framework for concurrent programs

Testing As a Service over Cloud

Application of Combinatorial Testing to Quantum Programs

Parallel Testing Based on Test Subsession Partitioning

A Parallel Implementation Strategy of Adaptive Testing

Isolating Failure-Inducing Combinations in Combinatorial Testing Using Test Augmentation and Classification

Performing unit testing based on testing as a service (TaaS) approach

A new concurrent test framework for distributed Hardware-in-the-Loop simulation test system

Testing and Fault Diagnosis for Web Application Compatibility Based on Combinatorial Method.

[email protected]: the virtual test lab on the cloud

A survey of combinatorial testing

A cloud-based TaaS infrastructure with tools for SaaS validation, performance and scalability evaluation

Survey of combinatorial test generation

An Approach for Service Composition and Testing for Cloud Computing

A Software Failure Debugging Method Based on Combinatorial Design Approach for Testing

Comparative Analysis of Constraint Handling Techniques for Constrained Combinatorial Testing.

Testing as a Service (TaaS) on Clouds

Towards a Scalable and Robust Multi-Tenancy SaaS