Abstract: Recent results suggest that quantum computers possess the potential to speed up nonconvex optimization problems. However, a crucial factor for the implementation of quantum optimization algorithms is their robustness against experimental and statistical noises. In this paper, we systematically study quantum algorithms for finding an $\epsilon$-approximate second-order stationary point ($\epsilon$-SOSP) of a $d$-dimensional nonconvex function, a fundamental problem in nonconvex optimization, with noisy zeroth- or first-order oracles as inputs. We first prove that, up to noise of $O(\epsilon^{10}/d^5)$, accelerated perturbed gradient descent with quantum gradient estimation takes $O(\log d/\epsilon^{1.75})$ quantum queries to find an $\epsilon$-SOSP. We then prove that perturbed gradient descent is robust to the noise of $O(\epsilon^6/d^4)$ and $O(\epsilon/d^{0.5+\zeta})$ for $\zeta>0$ on the zeroth- and first-order oracles, respectively, which provides a quantum algorithm with poly-logarithmic query complexity. We then propose a stochastic gradient descent algorithm using quantum mean estimation on the Gaussian smoothing of noisy oracles, which is robust to $O(\epsilon^{1.5}/d)$ and $O(\epsilon/\sqrt{d})$ noise on the zeroth- and first-order oracles, respectively. The quantum algorithm takes $O(d^{2.5}/\epsilon^{3.5})$ and $O(d^2/\epsilon^3)$ queries to the two oracles, giving a polynomial speedup over the classical counterparts. Moreover, we characterize the domains where quantum algorithms can find an $\epsilon$-SOSP with poly-logarithmic, polynomial, or exponential number of queries in $d$, or the problem is information-theoretically unsolvable even by an infinite number of queries. In addition, we prove an $\Omega(\epsilon^{-12/7})$ lower bound in $\epsilon$ for any randomized classical and quantum algorithm to find an $\epsilon$-SOSP using either noisy zeroth- or first-order oracles.

Quantum Algorithms for Escaping from Saddle Points

Quantum Algorithms for Non-smooth Non-convex Optimization

Escape Saddle Points by a Simple Gradient-Descent Based Algorithm

Robustness of Quantum Algorithms for Nonconvex Optimization

Quantum spectral method for gradient and Hessian estimation

Impact of Measurement Noise on Escaping Saddles in Variational Quantum Algorithms

Pure Quantum Gradient Descent Algorithm and Full Quantum Variational Eigensolver

Quantum Lower Bounds for Finding Stationary Points of Nonconvex Functions

Quantum algorithm for finding the negative curvature direction in non-convex optimization

Stochastic noise can be helpful for variational quantum algorithms

Improving quantum linear system solvers via a gradient descent perspective

Quantum conjugate gradient method using the positive-side quantum eigenvalue transformation

On Quantum Speedups for Nonconvex Optimization Via Quantum Tunneling Walks

Quantum gradient descent algorithms for nonequilibrium steady states and linear algebraic systems

Quantum Natural Gradient with Efficient Backtracking Line Search

Depth scaling of unstructured search via quantum approximate optimization

A Quantum Approximate Optimization Algorithm for continuous problems

Variational learning algorithms for quantum query complexity

Quantum Gram-Schmidt Processes and Their Application to Efficient State Readout for Quantum Algorithms

Iterative quantum algorithm for combinatorial optimization based on quantum gradient descent