Abstract:Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.

Maxwell Demon and Einstein-Podolsky-Rosen Steering

Maxwell Demon and Einstein-Podolsky-Rosen Steering

Demonstration of Maxwell Demon-assistant Einstein-Podolsky-Rosen Steering via Superconducting Quantum Processor

Quantum Maxwell's Demon Assisted by Non-Markovian Effects

Maxwell's demon across the quantum-to-classical transition

Quantum Steering: Practical Challenges and Perspectives

Engineering Asymmetric Steady-State Einstein-Podolsky-Rosen Steering in Macroscopic Hybrid Systems

Quantum Steering: Practical Challenges and Future Directions

Experimental Demonstration of the Einstein-Podolsky-Rosen Steering Game Based on the All-Versus-nothing Proof.

Maxwell's Demon for Quantum Transport

High-dimensional measurement-device-independent quantum steering and its application in randomness generation

Maxwell demon with anti-decoherence

Demonstration of Einstein-Podolsky-Rosen Steering with Enhanced Subchannel Discrimination

Realization of Quantum Maxwell’s Demon with Solid-State Spins *

Experimental Demonstration of a Maxwell's Demon Quantum Battery in a Superconducting Noisy Intermediate-Scale Quantum Processor

Experimental observation the Einstein-Podolsky-Rosen Steering based on the detection of entanglement.

Nonlinear bosonic Maxwell's demon

Experimental Quantification of Asymmetric Einstein-Podolsky-Rosen Steering.

A quantum-mechanical Maxwell's demon

Artificially intelligent Maxwell's demon for optimal control of open quantum systems

Maxwell'S Demon Assisted Thermodynamic Cycle In Superconducting Quantum Circuits