Questions and Concerns About Google's Quantum Supremacy Claim

Gil Kalai,Yosef Rinott,Tomer Shoham

2023-05-02

Abstract:In October 2019, Nature published a paper [6] describing an experimental work that was performed at Google. The paper claims to demonstrate quantum (computational) supremacy on a 53-qubit quantum computer. Since then we have been involved in a long-term project to study various statistical aspects of the Google experiment. In [30] we studied Google's statistical framework that we found to be very sound and offered some technical improvements. This document describes three main concerns (based on statistical analysis) about the Google 2019 experiment. The first concern is that the data do not agree with Google's noise model (or any other specific model). The second concern is that a crucial simple formula for a priori estimation of the fidelity seems to involve an unexpected independence assumption, and yet it gives very accurate predictions. The third concern is about statistical properties of the calibration process.

Quantum Physics,Computational Complexity,Statistics Theory

What problem does this paper attempt to address?

The paper primarily explores the statistical analysis issues in Google's 2019 claim of achieving quantum supremacy. Specifically, the authors Gil Kalai, Yosef Rinott, and Tomer Shoham raise three main concerns regarding Google's experiment:

1. **Data does not conform to Google's noise model**: The paper points out that the data generated in Google's experiment does not match the noise model proposed by Google. This implies that the experimental results might be influenced by other unidentified factors.

2. **Independence assumption in the prior estimation formula**: The paper finds that a key formula used to estimate fidelity (i.e., formula (77)) seems to include an unrealistic independence assumption, yet this formula can very accurately predict the experimental results. This predictive ability is surprising and requires further investigation.

3. **Statistical properties of the calibration process**: The paper also questions the effectiveness and statistical properties of the calibration process, suggesting that there are some unexplained phenomena in the calibration process, such as the significant differences in the calibration effects of different 2-gates.

Additionally, the paper discusses some general scientific issues, such as how to analyze samples from noisy quantum computers and how to find suitable models to describe experimental data. Overall, this paper aims to conduct an in-depth review of Google's quantum supremacy claim and raises some important statistical and technical questions.