Abstract:Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.

Optimizing measurement-based cooling by reinforcement learning

An almost deterministic cooling by measurements

Numerical Simulation and Experimental Verification of Dynamic Cooling and Temperature Control of the Optical Cavity in a Co2 Isotope Analyzer

Near-ground state cooling in electromechanics using measurement-based feedback and Josephson parametric amplifier

Measurement-induced Cooling of a Qubit in Structured Environments

Bayesian optimization of Bose-Einstein condensation via evaporative cooling model

Dynamic Cooling Of A Mechanical Resonator In The Strong Coupling Regime

Dynamic Dissipative Synchronized Cooling of Two Mechanical Resonators in Strong Coupling Optomechanics

Cooling of optomechanical system by coherent feedback

Finite-time quantum measurement cooling beyond the Carnot limit

Intelligent optimization method for real-time decision-making in laminated cooling configurations through reinforcement learning

Partial Optomechanical Refrigeration via Multimode Cold-Damping Feedback

Something from Nothing: Enhanced Laser Cooling of a Mechanical Resonator via Zero-Photon Detection

Review and experimental benchmarking of machine learning algorithms for efficient optimization of cold atom experiments

Dynamic acoustic optimization of pulse tube refrigerators for rapid cooldown

Dilute measurement-induced cooling into many-body ground states

Simultaneous Cooling of Coupled Mechanical Resonators in Cavity Optomechanics

Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning

Artificially intelligent Maxwell's demon for optimal control of open quantum systems

Enhancing sideband cooling by initial photon-phonon correlation

Optimal Limits Of Cavity Optomechanical Cooling In The Strong-Coupling Regime