Abstract:We propose fast and practical quantum-inspired classical algorithms for solving linear systems. Specifically, given sampling and query access to a matrix $A\in\mathbb{R}^{m\times n}$ and a vector $b\in\mathbb{R}^m$, we propose classical algorithms that produce a data structure for the solution $x\in\mathbb{R}^{n}$ of the linear system $Ax=b$ with the ability to sample and query its entries. The resulting $x$ satisfies $\|x-A^{+}b\|\leq\epsilon\|A^{+}b\|$, where $\|\cdot\|$ is the spectral norm and $A^+$ is the Moore-Penrose inverse of $A$. Our algorithm has time complexity $\widetilde{O}(\kappa_F^4/\kappa\epsilon^2)$ in the general case, where $\kappa_{F} =\|A\|_F\|A^+\|$ and $\kappa=\|A\|\|A^+\|$ are condition numbers. Compared to the prior state-of-the-art result [Shao and Montanaro, arXiv:2103.10309v2], our algorithm achieves a polynomial speedup in condition numbers. When $A$ is $s$-sparse, our algorithm has complexity $\widetilde{O}(s \kappa\log(1/\epsilon))$, matching the quantum lower bound for solving linear systems in $\kappa$ and $1/\epsilon$ up to poly-logarithmic factors [Harrow and Kothari]. When $A$ is $s$-sparse and symmetric positive-definite, our algorithm has complexity $\widetilde{O}(s\sqrt{\kappa}\log(1/\epsilon))$. Technically, our main contribution is the application of the heavy ball momentum method to quantum-inspired classical algorithms for solving linear systems, where we propose two new methods with speedups: quantum-inspired Kaczmarz method with momentum and quantum-inspired coordinate descent method with momentum. Their analysis exploits careful decomposition of the momentum transition matrix and the application of novel spectral norm concentration bounds for independent random matrices. Finally, we also conduct numerical experiments for our algorithms on both synthetic and real-world datasets, and the experimental results support our theoretical claims.

Partitioned Quantum Subspace Expansion

Measurement-efficient quantum Krylov subspace diagonalisation

Real-Time Krylov Theory for Quantum Computing Algorithms

A circuit-generated quantum subspace algorithm for the variational quantum eigensolver

Sampling Error Analysis in Quantum Krylov Subspace Diagonalization

Quantum Krylov-Subspace Method Based Linear Solver

Efficient Strategies for Reducing Sampling Error in Quantum Krylov Subspace Diagonalization

Unitary Partitioning and the Contextual Subspace Variational Quantum Eigensolver

Subspace recursive Fermi-operator expansion strategies for large-scale DFT eigenvalue problems on HPC architectures

Quantum subspace expansion in the presence of hardware noise

The theory of variational hybrid quantum-classical algorithms

A theory of quantum subspace diagonalization

Exact and efficient Lanczos method on a quantum computer

Variational Phase Estimation with Variational Fast Forwarding

Cheaper and more noise-resilient quantum state preparation using eigenvector continuation

Utilizing small quantum computers for machine learning and ground state energy approximation

Eigenvector Continuation with Subspace Learning

Variational quantum algorithm with information sharing

Fast and Practical Quantum-Inspired Classical Algorithms for Solving Linear Systems.

Quantum linear system algorithm with optimal queries to initial state preparation