Abstract:The training of a parameterized model largely depends on the landscape of the underlying loss function. In particular, vanishing gradients are a central bottleneck in the scalability of variational quantum algorithms (VQAs), and are known to arise in various ways. However, a caveat of most existing gradient bound results is the requirement of t-design circuit assumptions that are typically not satisfied in practice. In this work, we loosen these assumptions altogether and derive tight upper and lower bounds on loss and gradient concentration for a large class of parameterized quantum circuits and arbitrary observables, which are significantly stronger than prior work. Moreover, we show that these bounds, as well as the variance of the loss itself, can be estimated efficiently and classically-providing practical tools to study the loss landscapes of VQA models, including verifying whether or not a circuit/observable induces barren plateaus. In particular, our results can readily be leveraged to rule out barren plateaus for a realistic class of ansätze and mixed observables, namely, observables containing a non-vanishing local term. This insight has direct implications for hybrid Quantum Generative Adversarial Networks (qGANs). We prove that designing the discriminator appropriately leads to 1-local weights that stay constant in the number of qubits, regardless of discriminator depth. This implies that qGANs with appropriately chosen generators do not suffer from barren plateaus even at scale-making them a promising candidate for applications in generative quantum machine learning. We demonstrate this result by training a qGAN to learn a 2D mixture of Gaussian distributions with up to 16 qubits, and provide numerical evidence that global contributions to the gradient, while initially exponentially small, may kick in substantially over the course of training.

Trainability Enhancement of Parameterized Quantum Circuits via Reduced-Domain Parameter Initialization

Alleviating Barren Plateaus in Parameterized Quantum Machine Learning Circuits: Investigating Advanced Parameter Initialization Strategies

An initialization strategy for addressing barren plateaus in parametrized quantum circuits

Efficient estimation of trainability for variational quantum circuits

Learning Parameterized Quantum Circuits with Quantum Gradient

Escaping from the Barren Plateau Via Gaussian Initializations in Deep Variational Quantum Circuits

QAdaPrune: Adaptive Parameter Pruning For Training Variational Quantum Circuits

The Dilemma of Random Parameter Initialization and Barren Plateaus in Variational Quantum Algorithms

Avoiding barren plateaus via Gaussian Mixture Model

Capacity and quantum geometry of parametrized quantum circuits

Improving Trainability of Variational Quantum Circuits via Regularization Strategies

Mitigating barren plateaus with transfer-learning-inspired parameter initializations

Diffusion-Inspired Quantum Noise Mitigation in Parameterized Quantum Circuits

Quantum Circuit Training with Growth-Based Architectures

Machine-Learning Insights on Entanglement-trainability Correlation of Parameterized Quantum Circuits

A Parameter Initialization Method for Variational Quantum Algorithms to Mitigate Barren Plateaus Based on Transfer Learning

Non-asymptotic Approximation Error Bounds of Parameterized Quantum Circuits

Tight and Efficient Gradient Bounds for Parameterized Quantum Circuits

Statistics-Informed Parameterized Quantum Circuit via Maximum Entropy Principle for Data Science and Finance

Hybrid GRU-CNN Bilinear Parameters Initialization for Quantum Approximate Optimization Algorithm

Learning capability of parametrized quantum circuits