Neural-network Generated Quantum State Can Alleviate the Barren Plateau in Variational Quantum Circuits

Zhehao Yi,Rahul Bhadani

2024-11-13

Abstract:We find that using neural networks to generate quantum states can effectively alleviate the barren plateau phenomenon present in random variational quantum circuits.

Quantum Physics

What problem does this paper attempt to address?

Neural-network Variational Quantum Algorithm for Simulating Many-Body Dynamics

Chee Kong Lee,Pranay Patil,Shengyu Zhang,Chang Yu Hsieh

DOI: https://doi.org/10.1103/physrevresearch.3.023095

2021-01-01

Physical Review Research

Abstract:We propose a neural-network variational quantum algorithm to simulate the time evolution of quantum many-body systems. Based on a modified restricted Boltzmann machine (RBM) wave function ansatz, the proposed algorithm can be efficiently implemented in near-term quantum computers with low measurement cost. Using a qubit recycling strategy, only one ancilla qubit is required to represent all the hidden spins in an RBM architecture. The variational algorithm is extended to open quantum systems by employing a stochastic Schrodinger equation approach. Numerical simulations of spin-lattice models demonstrate that our algorithm is capable of capturing the dynamics of closed and open quantum many-body systems with high accuracy without suffering from the vanishing gradient (or "barren plateau") issue for the considered system sizes.
BEINIT: Avoiding Barren Plateaus in Variational Quantum Algorithms

Ankit Kulshrestha,Ilya Safro

DOI: https://doi.org/10.48550/arXiv.2204.13751

2022-04-29

Abstract:Barren plateaus are a notorious problem in the optimization of variational quantum algorithms and pose a critical obstacle in the quest for more efficient quantum machine learning algorithms. Many potential reasons for barren plateaus have been identified but few solutions have been proposed to avoid them in practice. Existing solutions are mainly focused on the initialization of unitary gate parameters without taking into account the changes induced by input data. In this paper, we propose an alternative strategy which initializes the parameters of a unitary gate by drawing from a beta distribution. The hyperparameters of the beta distribution are estimated from the data. To further prevent barren plateau during training we add a novel perturbation at every gradient descent step. Taking these ideas together, we empirically show that our proposed framework significantly reduces the possibility of a complex quantum neural network getting stuck in a barren plateau.

Quantum Physics,Machine Learning
Maximising Quantum-Computing Expressive Power through Randomised Circuits

Yingli Yang,Zongkang Zhang,Anbang Wang,Xiaosi Xu,Xiaoting Wang,Ying Li

DOI: https://doi.org/10.1103/PhysRevResearch.6.023098

2023-12-04

Abstract:In the noisy intermediate-scale quantum era, variational quantum algorithms (VQAs) have emerged as a promising avenue to obtain quantum advantage. However, the success of VQAs depends on the expressive power of parameterised quantum circuits, which is constrained by the limited gate number and the presence of barren plateaus. In this work, we propose and numerically demonstrate a novel approach for VQAs, utilizing randomised quantum circuits to generate the variational wavefunction. We parameterize the distribution function of these random circuits using artificial neural networks and optimize it to find the solution. This random-circuit approach presents a trade-off between the expressive power of the variational wavefunction and time cost, in terms of the sampling cost of quantum circuits. Given a fixed gate number, we can systematically increase the expressive power by extending the quantum-computing time. With a sufficiently large permissible time cost, the variational wavefunction can approximate any quantum state with arbitrary accuracy. Furthermore, we establish explicit relationships between expressive power, time cost, and gate number for variational quantum eigensolvers. These results highlight the promising potential of the random-circuit approach in achieving a high expressive power in quantum computing.

Quantum Physics,Machine Learning
Enhancing Variational Quantum Circuit Training: An Improved Neural Network Approach for Barren Plateau Mitigation

Zhehao Yi,Yanying Liang,Haozhen Situ

2024-11-14

Abstract:Combining classical optimization with parameterized quantum circuit evaluation, variational quantum algorithms (VQAs) are among the most promising algorithms in near-term quantum computing. Similar to neural networks (NNs), VQAs iteratively update circuit parameters to optimize a cost function. However, the training of variational quantum circuits (VQCs) is susceptible to a phenomenon known as barren plateaus (BPs). Various methods have been proposed to mitigate this issue, such as using neural networks to generate VQC parameters. In this paper, we improve the NN-based BP mitigation approach by refining the neural network architecture and extend its applicability to a more generalized scenario that includes random quantum inputs and VQC structures. We evaluate the effectiveness of this approach by comparing the convergence speed before and after it is utilized. Furthermore, we give an explanation for the effectiveness of this method by utilizing a loss landscape visualization technique and the expressibility metric of VQC. The smoothness of the loss landscape offers an intuitive insight into the method's utility, while the reduction in expressibility accounts for the enhanced trainability. Our research highlights the universal applicability of the NN-based BP mitigation approach, underscoring its potential to drive progress in the development of VQAs across diverse domains.

Quantum Physics
Variational Quantum-Neural Hybrid Eigensolver.

Shi-Xin Zhang,Zhou-Quan Wan,Chee-Kong Lee,Chang-Yu Hsieh,Shengyu Zhang,Hong Yao

DOI: https://doi.org/10.1103/physrevlett.128.120502

IF: 8.6

2022-01-01

Physical Review Letters

Abstract:The variational quantum eigensolver (VQE) is one of the most representative quantum algorithms in the noisy intermediate-scale quantum (NISQ) era, and is generally speculated to deliver one of the first quantum advantages for the ground-state simulations of some nontrivial Hamiltonians. However, short quantum coherence time and limited availability of quantum hardware resources in the NISQ hardware strongly restrain the capacity and expressiveness of VQEs. In this Letter, we introduce the variational quantum-neural hybrid eigensolver (VQNHE) in which the shallow-circuit quantum Ansatz can be further enhanced by classical post-processing with neural networks. We show that the VQNHE consistently and significantly outperforms the VQE in simulating ground-state energies of quantum spins and molecules given the same amount of quantum resources. More importantly, we demonstrate that, for arbitrary postprocessing neural functions, the VQNHE only incurs a polynomial overhead of processing time and represents the first scalable method to exponentially accelerate the VQE with nonunitary postprocessing that can be efficiently implemented in the NISQ era.
Beyond Barren Plateaus: Quantum Variational Algorithms Are Swamped With Traps

Eric R. Anschuetz,Bobak T. Kiani

DOI: https://doi.org/10.1038/s41467-022-35364-5

2022-09-28

Abstract:One of the most important properties of classical neural networks is how surprisingly trainable they are, though their training algorithms typically rely on optimizing complicated, nonconvex loss functions. Previous results have shown that unlike the case in classical neural networks, variational quantum models are often not trainable. The most studied phenomenon is the onset of barren plateaus in the training landscape of these quantum models, typically when the models are very deep. This focus on barren plateaus has made the phenomenon almost synonymous with the trainability of quantum models. Here, we show that barren plateaus are only a part of the story. We prove that a wide class of variational quantum models -- which are shallow, and exhibit no barren plateaus -- have only a superpolynomially small fraction of local minima within any constant energy from the global minimum, rendering these models untrainable if no good initial guess of the optimal parameters is known. We also study the trainability of variational quantum algorithms from a statistical query framework, and show that noisy optimization of a wide variety of quantum models is impossible with a sub-exponential number of queries. Finally, we numerically confirm our results on a variety of problem instances. Though we exclude a wide variety of quantum algorithms here, we give reason for optimism for certain classes of variational algorithms and discuss potential ways forward in showing the practical utility of such algorithms.

Quantum Physics
Neural Quantum States in Variational Monte Carlo Method: A Brief Summary

Yuntai Song

2024-06-03

Abstract:In this note, variational Monte Carlo method based on neural quantum states for spin systems is reviewed. Using a neural network as the wave function allows for a more generalized expression of various types of interactions, including highly non-local interactions, which are closely related to its non-linear activation functions. Additionally, neural networks can represent relatively complex wave functions with relatively small computational resources when dealing with higher-dimensional systems, which is undoubtedly a "flattening" advantage. In quantum-state tomography, the representation method of neural quantum states has already achieved significant results, hinting at its potential in handling larger-sized systems.

Strongly Correlated Electrons,Quantum Physics
Post-variational quantum neural networks

Po-Wei Huang,Patrick Rebentrost

2024-04-05

Abstract:Hybrid quantum-classical computing in the noisy intermediate-scale quantum (NISQ) era with variational algorithms can exhibit barren plateau issues, causing difficult convergence of gradient-based optimization techniques. In this paper, we discuss "post-variational strategies", which shift tunable parameters from the quantum computer to the classical computer, opting for ensemble strategies when optimizing quantum models. We discuss various strategies and design principles for constructing individual quantum circuits, where the resulting ensembles can be optimized with convex programming. Further, we discuss architectural designs of post-variational quantum neural networks and analyze the propagation of estimation errors throughout such neural networks. Finally, we show that empirically, post-variational quantum neural networks using our architectural designs can potentially provide better results than variational algorithms and performance comparable to that of two-layer neural networks.

Quantum Physics,Machine Learning
Optimizing Variational Quantum Neural Networks Based on Collective Intelligence

Zitong Li,Tailong Xiao,Xiaoyang Deng,Guihua Zeng,Weimin Li

DOI: https://doi.org/10.3390/math12111627

IF: 2.4

2024-05-23

Mathematics

Abstract:Quantum machine learning stands out as one of the most promising applications of quantum computing, widely believed to possess potential quantum advantages. In the era of noisy intermediate-scale quantum, the scale and quality of quantum computers are limited, and quantum algorithms based on fault-tolerant quantum computing paradigms cannot be experimentally verified in the short term. The variational quantum algorithm design paradigm can better adapt to the practical characteristics of noisy quantum hardware and is currently one of the most promising solutions. However, variational quantum algorithms, due to their highly entangled nature, encounter the phenomenon known as the "barren plateau" during the optimization and training processes, making effective optimization challenging. This paper addresses this challenging issue by researching a variational quantum neural network optimization method based on collective intelligence algorithms. The aim is to overcome optimization difficulties encountered by traditional methods such as gradient descent. We study two typical applications of using quantum neural networks: random 2D Hamiltonian ground state solving and quantum phase recognition. We find that the collective intelligence algorithm shows a better optimization compared to gradient descent. The solution accuracy of ground energy and phase classification is enhanced, and the optimization iterations are also reduced. We highlight that the collective intelligence algorithm has great potential in tackling the optimization of variational quantum algorithms.

mathematics
Escaping from the Barren Plateau Via Gaussian Initializations in Deep Variational Quantum Circuits

Kaining Zhang,Liu,Min-Hsiu Hsieh,Dacheng Tao

2022-01-01

Abstract:Variational quantum circuits have been widely employed in quantum simulation and quantum machine learning in recent years. However, quantum circuits with random structures have poor trainability due to the exponentially vanishing gradient with respect to the circuit depth and the qubit number. This result leads to a general standpoint that deep quantum circuits would not be feasible for practical tasks. In this work, we propose an initialization strategy with theoretical guarantees for the vanishing gradient problem in general deep quantum circuits. Specifically, we prove that under proper Gaussian initialized parameters, the norm of the gradient decays at most polynomially when the qubit number and the circuit depth increase. Our theoretical results hold for both the local and the global observable cases, where the latter was believed to have vanishing gradients even for very shallow circuits. Experimental results verify our theoretical findings in quantum simulation and quantum chemistry.
Avoiding barren plateaus in the variational determination of geometric entanglement

Leonardo Zambrano,Andrés Damián Muñoz-Moller,Mario Muñoz,Luciano Pereira Valenzuela,Aldo Delgado

DOI: https://doi.org/10.1088/2058-9565/ad2a16

IF: 6.568

2024-02-17

Quantum Science and Technology

Abstract:The barren plateau phenomenon is one of the main obstacles to implementing variational quantum algorithms in the current generation of quantum processors. Here, we introduce a method capable of avoiding the barren plateau phenomenon in the variational determination of the geometric measure of entanglement for a large number of qubits. The method is based on measuring compatible two-qubit local functions whose optimization allows for achieving a well-suited initial condition, from which a global function can be further optimized without encountering a barren plateau. We analytically demonstrate that the local functions can be efficiently estimated and optimized. Numerical simulations up to 18-qubit GHZ and W states demonstrate that the method converges to the exact value. In particular, the method allows for escaping from barren plateaus induced by hardware noise or global functions defined on high-dimensional systems. Numerical simulations with noise are in agreement with experiments carried out on IBM's quantum processors for 7 qubits.

physics, multidisciplinary,quantum science & technology
Training variational quantum algorithms with random gate activation

Shuo Liu,Shi-Xin Zhang,Shao-Kai Jian,Hong Yao

DOI: https://doi.org/10.1103/PhysRevResearch.5.L032040

2023-03-15

Abstract:Variational quantum algorithms (VQAs) hold great potentials for near-term applications and are promising to achieve quantum advantage on practical tasks. However, VQAs suffer from severe barren plateau problem as well as have a large probability of being trapped in local minima. In this Letter, we propose a novel training algorithm with random quantum gate activation for VQAs to efficiently address these two issues. This new algorithm processes effectively much fewer training parameters than the conventional plain optimization strategy, which efficiently mitigates barren plateaus with the same expressive capability. Additionally, by randomly adding two-qubit gates to the circuit ansatz, the optimization trajectories can escape from local minima and reach the global minimum more frequently due to more sources of randomness. In real quantum experiments, the new training algorithm can also reduce the quantum computational resources required and be more quantum noise resilient. We apply our training algorithm to solve variational quantum simulation problems for ground states and present convincing results that showcase the advantages of our novel strategy where better performance is achieved by the combination of mitigating barren plateaus, escaping from local minima, and reducing the effect of quantum noises. We further propose that the entanglement phase transition could be one underlying reason why our RA training is so effective.

Quantum Physics
Noise-Induced Barren Plateaus in Variational Quantum Algorithms

Samson Wang,Enrico Fontana,M. Cerezo,Kunal Sharma,Akira Sone,Lukasz Cincio,Patrick J. Coles

DOI: https://doi.org/10.1038/s41467-021-27045-6

2024-03-02

Abstract:Variational Quantum Algorithms (VQAs) may be a path to quantum advantage on Noisy Intermediate-Scale Quantum (NISQ) computers. A natural question is whether noise on NISQ devices places fundamental limitations on VQA performance. We rigorously prove a serious limitation for noisy VQAs, in that the noise causes the training landscape to have a barren plateau (i.e., vanishing gradient). Specifically, for the local Pauli noise considered, we prove that the gradient vanishes exponentially in the number of qubits $n$ if the depth of the ansatz grows linearly with $n$. These noise-induced barren plateaus (NIBPs) are conceptually different from noise-free barren plateaus, which are linked to random parameter initialization. Our result is formulated for a generic ansatz that includes as special cases the Quantum Alternating Operator Ansatz and the Unitary Coupled Cluster Ansatz, among others. For the former, our numerical heuristics demonstrate the NIBP phenomenon for a realistic hardware noise model.

Quantum Physics,Machine Learning
The promising path of evolutionary optimization to avoid barren plateaus

Jakab Nádori,Gregory Morse,Zita Majnay-Takács,Zoltán Zimborás,Péter Rakyta

2024-02-08

Abstract:Variational quantum algorithms are viewed as promising candidates for demonstrating quantum advantage on near-term devices. These approaches typically involve the training of parameterized quantum circuits through a classical optimization loop. However, they often encounter challenges attributed to the exponentially diminishing gradient components, known as the barren plateau (BP) problem. This work introduces a novel optimization method designed to alleviate the adverse effects of BPs during circuit training. Our approach to select the optimization search direction relies on the distant features of the cost-function landscape. This enables the optimization path to navigate around barren plateaus without the need for external control mechanisms. We have successfully applied our optimization strategy to quantum circuits comprising $16$ qubits and $15000$ entangling gates, demonstrating robust resistance against BPs. Additionally, we have extended our optimization strategy by incorporating an evolutionary selection framework, enhancing its ability to avoid local minima in the landscape. The modified algorithm has been successfully utilized in quantum gate synthesis applications, showcasing a significantly improved efficiency in generating highly compressed quantum circuits compared to traditional gradient-based optimization approaches.

Quantum Physics
Surviving The Barren Plateau in Variational Quantum Circuits with Bayesian Learning Initialization

Ali Rad,Alireza Seif,Norbert M. Linke

DOI: https://doi.org/10.48550/arXiv.2203.02464

2022-03-05

Abstract:Variational quantum-classical hybrid algorithms are seen as a promising strategy for solving practical problems on quantum computers in the near term. While this approach reduces the number of qubits and operations required from the quantum machine, it places a heavy load on a classical optimizer. While often under-appreciated, the latter is a computationally hard task due to the barren plateau phenomenon in parameterized quantum circuits. The absence of guiding features like gradients renders conventional optimization strategies ineffective as the number of qubits increases. Here, we introduce the fast-and-slow algorithm, which uses Bayesian Learning to identify a promising region in parameter space. This is used to initialize a fast local optimizer to find the global optimum point efficiently. We illustrate the effectiveness of this method on the Bars-and-Stripes (BAS) quantum generative model, which has been studied on several quantum hardware platforms. Our results move variational quantum algorithms closer to their envisioned applications in quantum chemistry, combinatorial optimization, and quantum simulation problems.

Quantum Physics
An initialization strategy for addressing barren plateaus in parametrized quantum circuits

Edward Grant,Leonard Wossnig,Mateusz Ostaszewski,Marcello Benedetti

DOI: https://doi.org/10.22331/q-2019-12-09-214

2019-12-09

Quantum

Abstract:Parametrized quantum circuits initialized with random initial parameter values are characterized by barren plateaus where the gradient becomes exponentially small in the number of qubits. In this technical note we theoretically motivate and empirically validate an initialization strategy which can resolve the barren plateau problem for practical applications. The technique involves randomly selecting some of the initial parameter values, then choosing the remaining values so that the circuit is a sequence of shallow blocks that each evaluates to the identity. This initialization limits the effective depth of the circuits used to calculate the first parameter update so that they cannot be stuck in a barren plateau at the start of training. In turn, this makes some of the most compact ansätze usable in practice, which was not possible before even for rather basic problems. We show empirically that variational quantum eigensolvers and quantum neural networks initialized using this strategy can be trained using a gradient based method.

physics, multidisciplinary,quantum science & technology
Neural-network quantum states for many-body physics

Matija Medvidović,Javier Robledo Moreno

DOI: https://doi.org/10.1140/epjp/s13360-024-05311-y

2024-08-16

Abstract:Variational quantum calculations have borrowed many tools and algorithms from the machine learning community in the recent years. Leveraging great expressive power and efficient gradient-based optimization, researchers have shown that trial states inspired by deep learning problems can accurately model many-body correlated phenomena in spin, fermionic and qubit systems. In this review, we derive the central equations of different flavors variational Monte Carlo (VMC) approaches, including ground state search, time evolution and overlap optimization, and discuss data-driven tasks like quantum state tomography. An emphasis is put on the geometry of the variational manifold as well as bottlenecks in practical implementations. An overview of recent results of first-principles ground-state and real-time calculations is provided.

Disordered Systems and Neural Networks,Quantum Physics
Avoiding Barren Plateaus with Entanglement

Yuhan Yao,Yoshihiko Hasegawa

2024-06-06

Abstract:In the search for quantum advantage with near-term quantum devices, navigating the optimization landscape is significantly hampered by the barren plateaus phenomenon. This study presents a strategy to overcome this obstacle without changing the quantum circuit architecture. We propose incorporating auxiliary control qubits to shift the circuit from a unitary $2$-design to a unitary $1$-design, mitigating the prevalence of barren plateaus. We then remove these auxiliary qubits to return to the original circuit structure while preserving the unitary $1$-design properties. Our experiment suggests that the proposed structure effectively mitigates the barren plateaus phenomenon. A significant experimental finding is that the gradient of $\theta_{1,1}$, the first parameter in the quantum circuit, displays a broader distribution as the number of qubits and layers increases. This suggests a higher probability of obtaining effective gradients. This stability is critical for the efficient training of quantum circuits, especially for larger and more complex systems. The results of this study represent a significant advance in the optimization of quantum circuits and offer a promising avenue for the scalable and practical implementation of quantum computing technologies. This approach opens up new opportunities in quantum learning and other applications that require robust quantum computing power.

Quantum Physics

Neural-network Generated Quantum State Can Alleviate the Barren Plateau in Variational Quantum Circuits

Neural-network Variational Quantum Algorithm for Simulating Many-Body Dynamics

BEINIT: Avoiding Barren Plateaus in Variational Quantum Algorithms

Maximising Quantum-Computing Expressive Power through Randomised Circuits

Enhancing Variational Quantum Circuit Training: An Improved Neural Network Approach for Barren Plateau Mitigation

Variational Quantum-Neural Hybrid Eigensolver.

Beyond Barren Plateaus: Quantum Variational Algorithms Are Swamped With Traps

Neural Quantum States in Variational Monte Carlo Method: A Brief Summary

Post-variational quantum neural networks

Optimizing Variational Quantum Neural Networks Based on Collective Intelligence

Escaping from the Barren Plateau Via Gaussian Initializations in Deep Variational Quantum Circuits

Avoiding barren plateaus in the variational determination of geometric entanglement

Training variational quantum algorithms with random gate activation

Noise-Induced Barren Plateaus in Variational Quantum Algorithms

The promising path of evolutionary optimization to avoid barren plateaus

Surviving The Barren Plateau in Variational Quantum Circuits with Bayesian Learning Initialization

An initialization strategy for addressing barren plateaus in parametrized quantum circuits

Neural-network quantum states for many-body physics

Avoiding Barren Plateaus with Entanglement