Abstract:The quantum alternating operator ansatz (QAOA) is a prominent example of variational quantum algorithms. We propose a generalized QAOA called CD-QAOA, which is inspired by the counterdiabatic driving procedure, designed for quantum many-body systems and optimized using a reinforcement learning (RL) approach. The resulting hybrid control algorithm proves versatile in preparing the ground state of quantum-chaotic many-body spin chains by minimizing the energy. We show that using terms occurring in the adiabatic gauge potential as generators of additional control unitaries, it is possible to achieve fast high-fidelity many-body control away from the adiabatic regime. While each unitary retains the conventional QAOA-intrinsic continuous control degree of freedom such as the time duration, we consider the order of the multiple available unitaries appearing in the control sequence as an additional discrete optimization problem. Endowing the policy gradient algorithm with an autoregressive deep learning architecture to capture causality, we train the RL agent to construct optimal sequences of unitaries. The algorithm has no access to the quantum state, and we find that the protocol learned on small systems may generalize to larger systems. By scanning a range of protocol durations, we present numerical evidence for a finite quantum speed limit in the nonintegrable mixed-field spin-1/2 Ising and Lipkin-Meshkov-Glick models, and for the suitability to prepare ground states of the spin-1 Heisenberg chain in the long-range and topologically ordered parameter regimes. This work paves the way to incorporate recent success from deep learning for the purpose of quantum many-body control.

Control Design Of Two-Level Quantum Systems With Reinforcement Learning

A quantum system control method based on enhanced reinforcement learning

Controlling nonergodicity in quantum many-body systems by reinforcement learning

Quantum Control based on Deep Reinforcement Learning

When does reinforcement learning stand out in quantum control? A comparative study on state preparation

Experimentally Realizing Efficient Quantum Control with Reinforcement Learning

Control Of Five-Qubit System Based On Quantum Reinforcement Learning

A reinforcement learning approach for quantum state engineering

Non-Markovian Quantum Control via Model Maximum Likelihood Estimation and Reinforcement Learning

Robust Optimization for Quantum Reinforcement Learning Control Using Partial Observations

Auxiliary Task-based Deep Reinforcement Learning for Quantum Control

Quantum Learning Control Using Differential Evolution with Equally-Mixed Strategies

Universal Quantum Control through Deep Reinforcement Learning

Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving

Molecular Quantum Control Algorithm Design by Reinforcement Learning

Sample-efficient Model-based Reinforcement Learning for Quantum Control

Re-exploring Control Strategies in a Non-Markovian Open Quantum System by Reinforcement Learning

Learning Control of Quantum Systems

Challenges for Reinforcement Learning in Quantum Circuit Design

Experimentally Realizing Efficient Quantum Control with Reinforcement Learning

Arbitrary quantum states preparation aided by deep reinforcement learning