Abstract:Quantum 8, 1484 (2024). https://doi.org/10.22331/q-2024-09-25-1484 The training of a parameterized model largely depends on the landscape of the underlying loss function. In particular, vanishing gradients are a central bottleneck in the scalability of variational quantum algorithms (VQAs), and are known to arise in various ways. However, a caveat of most existing gradient bound results is the requirement of t-design circuit assumptions that are typically not satisfied in practice. In this work, we loosen these assumptions altogether and derive tight upper and lower bounds on loss and gradient concentration for a large class of parameterized quantum circuits and arbitrary observables, which are significantly stronger than prior work. Moreover, we show that these bounds, as well as the variance of the loss itself, can be estimated efficiently and classically-providing practical tools to study the loss landscapes of VQA models, including verifying whether or not a circuit/observable induces barren plateaus. In particular, our results can readily be leveraged to rule out barren plateaus for a realistic class of ansätze and mixed observables, namely, observables containing a non-vanishing local term. This insight has direct implications for hybrid Quantum Generative Adversarial Networks (qGANs). We prove that designing the discriminator appropriately leads to 1-local weights that stay constant in the number of qubits, regardless of discriminator depth. This implies that qGANs with appropriately chosen generators do not suffer from barren plateaus even at scale-making them a promising candidate for applications in generative quantum machine learning. We demonstrate this result by training a qGAN to learn a 2D mixture of Gaussian distributions with up to 16 qubits, and provide numerical evidence that global contributions to the gradient, while initially exponentially small, may kick in substantially over the course of training.

Adaptive Quantum Generative Training using an Unbounded Loss Function

Quantum Generative Training Using Rényi Divergences

Re-QGAN: an optimized adversarial quantum circuit learning framework

Quantum Generative Model with Variable-Depth Circuit

Learning and Inference on Generative Adversarial Quantum Circuits

Trainability barriers and opportunities in quantum generative modeling

Quantum Generative Adversarial Imitation Learning

Tight and Efficient Gradient Bounds for Parameterized Quantum Circuits

Neural-network Variational Quantum Algorithm for Simulating Many-Body Dynamics

Non-Variational ADAPT algorithm for quantum simulations

Generative training of quantum Boltzmann machines with hidden units

Hierarchical Learning for Quantum ML: Novel Training Technique for Large-Scale Variational Quantum Circuits

Adaptive projected variational quantum dynamics

Entanglement Devised Barren Plateau Mitigation

Quantum Deep Generative Prior with Programmable Quantum Circuits

Quantum-assisted associative adversarial network: Applying quantum annealing in deep learning

Quantum Natural Gradient with Efficient Backtracking Line Search

The promising path of evolutionary optimization to avoid barren plateaus

Quantum Natural Stochastic Pairwise Coordinate Descent

Adiabatic training for Variational Quantum Algorithms