Abstract:Recent advances in reinforcement learning have demonstrated the potential of quantum learning models based on parametrized quantum circuits as an alternative to deep learning models. On the one hand, these findings have shown the ultimate exponential speed-ups in learning that full-blown quantum models can offer in certain -- artificially constructed -- environments. On the other hand, they have demonstrated the ability of experimentally accessible PQCs to solve OpenAI Gym benchmarking tasks. However, it remains an open question whether these near-term QRL techniques can be successfully applied to more complex problems exhibiting high-dimensional observation spaces. In this work, we bridge this gap and present a hybrid model combining a PQC with classical feature encoding and post-processing layers that is capable of tackling Atari games. A classical model, subjected to architectural restrictions similar to those present in the hybrid model is constructed to serve as a reference. Our numerical investigation demonstrates that the proposed hybrid model is capable of solving the Pong environment and achieving scores comparable to the classical reference in Breakout. Furthermore, our findings shed light on important hyperparameter settings and design choices that impact the interplay of the quantum and classical components. This work contributes to the understanding of near-term quantum learning models and makes an important step towards their deployment in real-world RL scenarios.

A Quantum Reinforcement Learning Method For Repeated Game Theory

Reinforcement learning for Quantum Tiq-Taq-Toe

Reinforcement Learning with Quantum Variational Circuits

Quantum repeated games revisited

Repeated quantum game as a stochastic game: Effects of the shadow of the future and entanglement

An Introduction to Quantum Reinforcement Learning (QRL)

Quantum Computation For Action Selection Using Reinforcement Learning

A quantum-classical reinforcement learning model to play Atari games

Quantum Reinforcement Learning Method and Application Based on Value Function

Quantum deep Q learning with distributed prioritized experience replay

Infinitely repeated quantum games and strategic efficiency

Efficient quantum recurrent reinforcement learning via quantum reservoir computing

When does reinforcement learning stand out in quantum control? A comparative study on state preparation

Trends in quantum reinforcement learning: State‐of‐the‐arts and the road ahead

Quantum Reinforcement Learning for Multi-Armed Bandits

Control Design Of Two-Level Quantum Systems With Reinforcement Learning

Auxiliary Task-based Deep Reinforcement Learning for Quantum Control

Quantum noise modeling through Reinforcement Learning

A Quantum States Preparation Method Based on Difference-Driven Reinforcement Learning

QTRL: Toward Practical Quantum Reinforcement Learning via Quantum-Train