Abstract:Quantum 6, 707 (2022). https://doi.org/10.22331/q-2022-05-09-707 The quantum volume test is a full-system benchmark for quantum computers that is sensitive to qubit number, fidelity, connectivity, and other quantities believed to be important in building useful devices. The test was designed to produce a single-number measure of a quantum computer's general capability, but a complete understanding of its limitations and operational meaning is still missing. We explore the quantum volume test to better understand its design aspects, sensitivity to errors, passing criteria, and what passing implies about a quantum computer. We elucidate some transient behaviors the test exhibits for small qubit number including the ideal measurement output distributions and the efficacy of common compiler optimizations. We then present an efficient algorithm for estimating the expected heavy output probability under different error models and compiler optimization options, which predicts performance goals for future systems. Additionally, we explore the original confidence interval construction and show that it underachieves the desired coverage level for single shot experiments and overachieves for more typical number of shots. We propose a new confidence interval construction that reaches the specified coverage for typical number of shots and is more efficient in the number of circuits needed to pass the test. We demonstrate these savings with a experimental dataset collected from Quantinuum System Model H1-1. Finally, we discuss what the quantum volume test implies about a quantum computer's practical or operational abilities especially in terms of quantum error correction. Repository of code used in simulation and analysis: https://github.com/CQCL/qvtsim

Generating Failing Test Suites for Quantum Programs with Search (hot off the Press Track at GECCO 2022).

QuSBT: Search-Based Testing of Quantum Programs

Application of Combinatorial Testing to Quantum Programs

Quito - a Coverage-Guided Test Generator for Quantum Programs.

QuCAT: A Combinatorial Testing Tool for Quantum Software

Mutation-based Test Generation for Quantum Programs with Multi-Objective Search

A Survey on Testing and Analysis of Quantum Software

Assessing the Effectiveness of Input and Output Coverage Criteria for Testing Quantum Programs

Testing Multi-Subroutine Quantum Programs: From Unit Testing to Integration Testing

Quantum Program Testing Through Commuting Pauli Strings on IBM's Quantum Computers

Quantum software testing: State of the art

Testing Quantum Programs with Multiple Subroutines

Quantum Symbolic Execution

QuanFuzz: Fuzz Testing of Quantum Program.

Quantum Software Testing: A Brief Introduction.

Quantum Software Testing: Challenges, Early Achievements, and Opportunities

Poster: Fuzz Testing of Quantum Program

Quantum Severalty: Speed-up and Suppress Effect in Searching Problem

Equivalence, Identity, and Unitarity Checking in Black-Box Testing of Quantum Programs

Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations