Abstract:Model bias is an inherent limitation of the current dominant approach to optimal quantum control, which relies on a system simulation for optimization of control policies. To overcome this limitation, we propose a circuit-based approach for training a reinforcement learning agent on quantum control tasks in a model-free way. Given a continuously parametrized control circuit, the agent learns its parameters through trial-and-error interaction with the quantum system, using measurement outcomes as the only source of information about the quantum state. Focusing on control of a harmonic oscillator coupled to an ancilla qubit, we show how to reward the learning agent with measurements of experimentally available observables. We train the agent to prepare various nonclassical states via both unitary control and control with adaptive measurement-based quantum feedback, and to execute logical gates on encoded qubits. The agent does not rely on averaging for state tomography or fidelity estimation, and significantly outperforms widely used model-free methods in terms of sample efficiency. Our numerical work is of immediate relevance to superconducting circuits and trapped ions platforms where such training can be implemented in experiment, allowing complete elimination of model bias and the adaptation of quantum control policies to the specific system in which they are deployed. https://doi.org/10.1103/PhysRevX.12.011059 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

Short quantum circuits in reinforcement learning policies for the vehicle routing problem

Quantum Neural Networks for a Supply Chain Logistics Application

Quantum Deep Reinforcement Learning for Robot Navigation Tasks

Brain-Inspired Agents for Quantum Reinforcement Learning

Challenges for Reinforcement Learning in Quantum Circuit Design

Nav-Q: Quantum Deep Reinforcement Learning for Collision-Free Navigation of Self-Driving Cars

On the optimality of quantum circuit initial mapping using reinforcement learning

Quantum Multi-Agent Reinforcement Learning for Aerial Ad-hoc Networks

Variational Quantum Circuits for Deep Reinforcement Learning

Quantum enhancements for deep reinforcement learning in large spaces

Reinforcement Learning with Quantum Variational Circuits

Reinforcement-Learning-Based Variational Quantum Circuits Optimization for Combinatorial Problems

Model-Free Quantum Control with Reinforcement Learning

A Reinforcement Learning Environment for Directed Quantum Circuit Synthesis

AlphaRouter: Quantum Circuit Routing with Reinforcement Learning and Tree Search

Practical and efficient quantum circuit synthesis and transpiling with Reinforcement Learning

Dynamic Inhomogeneous Quantum Resource Scheduling with Reinforcement Learning

Universal Quantum Control through Deep Reinforcement Learning

Quantum policy gradient algorithms

AI drive: quantum-computational DRL framework for EHV navigational efficiency and security augmentation

A reinforcement learning approach for quantum state engineering