Abstract:Quantum machine learning through variational quantum algorithms (VQAs) has gained substantial attention in recent years. VQAs employ parameterized quantum circuits, which are typically optimized using gradient-based methods. However, these methods often exhibit sub-optimal convergence performance due to their dependence on Euclidean geometry. The quantum natural gradient descent (QNGD) optimization method, which considers the geometry of the quantum state space via a quantum information (Riemannian) metric tensor, provides a more effective optimization strategy. Despite its advantages, QNGD encounters notable challenges for learning from quantum data, including the no-cloning principle, which prohibits the replication of quantum data, state collapse, and the measurement postulate, which leads to the stochastic loss function. This paper introduces the quantum natural stochastic pairwise coordinate descent (2-QNSCD) optimization method. This method leverages the curved geometry of the quantum state space through a novel ensemble-based quantum information metric tensor, offering a more physically realizable optimization strategy for learning from quantum data. To improve computational efficiency and reduce sample complexity, we develop a highly sparse unbiased estimator of the novel metric tensor using a quantum circuit with gate complexity $\Theta(1)$ times that of the parameterized quantum circuit and single-shot quantum measurements. Our approach avoids the need for multiple copies of quantum data, thus adhering to the no-cloning principle. We provide a detailed theoretical foundation for our optimization method, along with an exponential convergence analysis. Additionally, we validate the utility of our method through a series of numerical experiments.

Application of Langevin Dynamics to Advance the Quantum Natural Gradient Optimization Algorithm

Quantum Langevin Dynamics for Optimization

Random Natural Gradient

Optimizing Variational Quantum Algorithms with qBang: Efficiently Interweaving Metric and Momentum to Navigate Flat Energy Landscapes

Quantum Natural Gradient with Efficient Backtracking Line Search

Quantum Natural Gradient with Geodesic Corrections for Small Shallow Quantum Circuits

Pure Quantum Gradient Descent Algorithm and Full Quantum Variational Eigensolver

Experimental quantum natural gradient optimization in photonics

Quantum gradient descent algorithms for nonequilibrium steady states and linear algebraic systems

A Quantum Approximate Optimization Algorithm for continuous problems

Stochastic optimization algorithms for quantum applications

Quantum algorithm for robust optimization via stochastic-gradient online learning

Neural-network Variational Quantum Algorithm for Simulating Many-Body Dynamics

Quantum Natural Stochastic Pairwise Coordinate Descent

Quantum Shadow Gradient Descent for Variational Quantum Algorithms

Improving Gradient Methods via Coordinate Transformations: Applications to Quantum Machine Learning

Natural Gradient Optimization for Optical Quantum Circuits

Quantum natural gradient without monotonicity

Kernel Descent -- a Novel Optimizer for Variational Quantum Algorithms

Optimizing quantum circuits with Riemannian gradient flow

QuACK: Accelerating Gradient-Based Quantum Optimization with Koopman Operator Learning