Deep-Q Learning with Hybrid Quantum Neural Network on Solving Maze Problems

Hao-Yuan Chen,Yen-Jui Chang,Shih-Wei Liao,Ching-Ray Chang

2023-12-02

Abstract:Quantum computing holds great potential for advancing the limitations of machine learning algorithms to handle higher dimensions of data and reduce overall training parameters in deep learning (DL) models. This study uses a trainable variational quantum circuit (VQC) on a gate-based quantum computing model to investigate the potential for quantum benefit in a model-free reinforcement learning problem. Through a comprehensive investigation and evaluation of the current model and capabilities of quantum computers, we designed and trained a novel hybrid quantum neural network based on the latest Qiskit and PyTorch framework. We compared its performance with a full-classical CNN with and without an incorporated VQC. Our research provides insights into the potential of deep quantum learning to solve a maze problem and, potentially, other reinforcement learning problems. We conclude that reinforcement learning problems can be practical with reasonable training epochs. Moreover, a comparative study of full-classical and hybrid quantum neural networks is discussed to understand these two approaches' performance, advantages, and disadvantages to deep-Q learning problems, especially on larger-scale maze problems larger than 4x4.

Quantum Physics,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to use the Hybrid Quantum Neural Network (HQNN) to solve the maze problem and explore its potential in model - free reinforcement learning. Specifically, the researchers designed and trained a new HQNN, based on the latest Qiskit and PyTorch frameworks, aiming to reduce the number of parameters in traditional deep - learning models, improve the ability to handle high - dimensional data, and at the same time reduce the overall training parameters, thereby improving training efficiency and performance. By comparing with the fully - classical Convolutional Neural Network (CNN), the researchers evaluated the performance of HQNN in solving maze problems of different scales, especially for larger - scale maze problems larger than 4x4. In addition, the study also explored the comparison between HQNN and classical CNN in terms of performance, advantages and disadvantages, in order to better understand the application of these two methods in deep Q - learning problems.

Deep-Q Learning with Hybrid Quantum Neural Network on Solving Maze Problems

Reinforcement Learning with Quantum Variational Circuits

Variational Quantum Circuits for Deep Reinforcement Learning

Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning

Neural Predictor Based Quantum Architecture Search

Quantum Machine Learning Architecture Search via Deep Reinforcement Learning

VQNet: Library for a Quantum-Classical Hybrid Neural Network

Solving Quantum Master Equations with Deep Quantum Neural Networks

Quantum enhancements for deep reinforcement learning in large spaces

DeepQMLP: A Scalable Quantum-Classical Hybrid DeepNeural Network Architecture for Classification

Brain-Inspired Agents for Quantum Reinforcement Learning

Gate-based Quantum Neurons in Hybrid Neural Networks

Quantum Deep Reinforcement Learning for Robot Navigation Tasks

Optimization of Reinforcement Learning Using Quantum Computation

QTRL: Toward Practical Quantum Reinforcement Learning via Quantum-Train

Quantum-inspired activation functions and quantum Chebyshev-polynomial network

Hybrid Quantum Neural Network in High-dimensional Data Classification

A Novel Spatial-Temporal Variational Quantum Circuit to Enable Deep Learning on NISQ Devices

A quantum-classical reinforcement learning model to play Atari games

Quantum Transfer Learning for Real-World, Small, and High-Dimensional Datasets

Quantum Neural Network for Quantum Neural Computing