Abstract:Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.

Optimal Finite-time Maxwell's Demons in Langevin Systems

Finite-time thermodynamic bounds and tradeoff relations for information processing

Artificially intelligent Maxwell's demon for optimal control of open quantum systems

Nonlinear bosonic Maxwell's demon

Quantum Maxwell's Demon Assisted by Non-Markovian Effects

Pseudo-spin Kondo effect versus hybridized molecular states in parallel Double Quantum Dots

Maxwell's demon across the quantum-to-classical transition

Modified Landauer's principle: How much can the Maxwell's demon gain by using general system-environment quantum state?

Maxwell's Demon walks into Wall Street: Stochastic Thermodynamics meets Expected Utility Theory

Maxwell's Demon and Data Compression

A Maxwell demon model connecting information and thermodynamics

A quantum-mechanical Maxwell's demon

Optimisation of time-ordered processes in the finite and asymptotic regime

The Physics of Maxwell's demon and information

N-States Continuous Maxwell Demon

Maxwell's Demon for Quantum Transport

Non-equilibrium Processes and Their Minimal Entropy Production

A many-particle bosonic quantum Maxwell demon

Thermodynamically Optimal Information Gain in Finite Time Measurement

A Maxwell demon that can work at macroscopic scales

Information flows in macroscopic Maxwell's demons