Abstract:We study quantum speedups in quantum machine learning (QML) by analyzing the quantum singular value transformation (QSVT) framework. QSVT, introduced by [GSLW, STOC'19, <a class="link-https" data-arxiv-id="1806.01838" href="https://arxiv.org/abs/1806.01838">arXiv:1806.01838</a>], unifies all major types of quantum speedup; in particular, a wide variety of QML proposals are applications of QSVT on low-rank classical data. We challenge these proposals by providing a classical algorithm that matches the performance of QSVT in this regime up to a small polynomial overhead. We show that, given a matrix $A \in \mathbb{C}^{m\times n}$, a vector $b \in \mathbb{C}^{n}$, a bounded degree-$d$ polynomial $p$, and linear-time pre-processing, we can output a description of a vector $v$ such that $\|v - p(A) b\| \leq \varepsilon\|b\|$ in $\widetilde{\mathcal{O}}(d^{11} \|A\|_{\mathrm{F}}^4 / (\varepsilon^2 \|A\|^4 ))$ time. This improves upon the best known classical algorithm [CGLLTW, STOC'20, <a class="link-https" data-arxiv-id="1910.06151" href="https://arxiv.org/abs/1910.06151">arXiv:1910.06151</a>], which requires $\widetilde{\mathcal{O}}(d^{22} \|A\|_{\mathrm{F}}^6 /(\varepsilon^6 \|A\|^6 ) )$ time, and narrows the gap with QSVT, which, after linear-time pre-processing to load input into a quantum-accessible memory, can estimate the magnitude of an entry $p(A)b$ to $\varepsilon\|b\|$ error in $\widetilde{\mathcal{O}}(d\|A\|_{\mathrm{F}}/(\varepsilon \|A\|))$ time. Our key insight is to combine the Clenshaw recurrence, an iterative method for computing matrix polynomials, with sketching techniques to simulate QSVT classically. We introduce several new classical techniques in this work, including (a) a non-oblivious matrix sketch for approximately preserving bi-linear forms, (b) a new stability analysis for the Clenshaw recurrence, and (c) a new technique to bound arithmetic progressions of the coefficients appearing in the Chebyshev series expansion of bounded functions, each of which may be of independent interest.

Robust Dequantization of the Quantum Singular value Transformation and Quantum Machine Learning Algorithms

Sampling-based sublinear low-rank matrix arithmetic framework for dequantizing quantum machine learning

Dequantizing the Quantum Singular Value Transformation: Hardness and Applications to Quantum Chemistry and the Quantum PCP Conjecture

Non-Unitary Quantum Machine Learning

Potential and limitations of random Fourier features for dequantizing quantum machine learning

A survey on HHL algorithm: From theory to application in quantum machine learning

Dequantizing quantum machine learning models using tensor networks

Robustness Verification of Quantum Machine Learning.

Unifying (Quantum) Statistical and Parametrized (Quantum) Algorithms

Quadratic Advantage with Quantum Randomized Smoothing Applied to Time-Series Analysis

Certainty In, Certainty Out: REVQCs for Quantum Machine Learning

A quantum-inspired algorithm for approximating statistical leverage scores

An Improved Classical Singular Value Transformation for Quantum Machine Learning

Quantum-enhanced Least-Square Support Vector Machine: Simplified Quantum Algorithm and Sparse Solutions

Scalable Quantum Algorithms for Noisy Quantum Computers

Towards Efficient Quantum Anomaly Detection: One-Class SVMs using Variable Subsampling and Randomized Measurements

Quantum Machine Learning: Quantum Kernel Methods

Quantum Geometric Machine Learning

Robustness Verification of Quantum Classifiers

When Quantum and Classical Models Disagree: Learning Beyond Minimum Norm Least Square

Adversarial Robustness Guarantees for Quantum Classifiers