Abstract:Modular, distributed and multi-core architectures are currently considered a promising approach for scalability of quantum computing systems. The integration of multiple Quantum Processing Units necessitates classical and quantum-coherent communication, introducing challenges related to noise and quantum decoherence in quantum state transfers between cores. Optimizing communication becomes imperative, and the compilation and mapping of quantum circuits onto physical qubits must minimize state transfers while adhering to architectural constraints. The compilation process, inherently an NP-hard problem, demands extensive search times even with a small number of qubits to be solved to optimality. To address this challenge efficiently, we advocate for the utilization of heuristic mappers that can rapidly generate solutions. In this work, we propose a novel approach employing Deep Reinforcement Learning (DRL) methods to learn these heuristics for a specific multi-core architecture. Our DRL agent incorporates a Transformer encoder and Graph Neural Networks. It encodes quantum circuits using self-attention mechanisms and produce outputs through an attention-based pointer mechanism that directly signifies the probability of matching logical qubits with physical cores. This enables the selection of optimal cores for logical qubits efficiently. Experimental evaluations show that the proposed method can outperform baseline approaches in terms of reducing inter-core communications and minimizing online time-to-solution. This research contributes to the advancement of scalable quantum computing systems by introducing a novel learning-based heuristic approach for efficient quantum circuit compilation and mapping.

Deep Reinforcement Learning with Curriculum Design for Quantum State Classification

Deep Reinforcement Learning with Reward Design for Quantum Control

Event-Based Deep Reinforcement Learning for Quantum Control

Quantum-Inspired Reinforcement Learning for Quantum Control

Arbitrary quantum states preparation aided by deep reinforcement learning

Quantum Curriculum Learning

Control Design Of Two-Level Quantum Systems With Reinforcement Learning

Auxiliary Task-based Deep Reinforcement Learning for Quantum Control

Deep quantum networks for classification

A reinforcement learning approach for quantum state engineering

Deep reinforcement learning for quantum Hamiltonian engineering

A Quantum States Preparation Method Based on Difference-Driven Reinforcement Learning

Classifying global state preparation via deep reinforcement learning

Quantum Deep Reinforcement Learning for Robot Navigation Tasks

Deep reinforcement learning for universal quantum state preparation via dynamic pulse control

Challenges for Reinforcement Learning in Quantum Circuit Design

Quantum Machine Learning Architecture Search via Deep Reinforcement Learning

Controlling nonergodicity in quantum many-body systems by reinforcement learning

Experimentally Realizing Efficient Quantum Control with Reinforcement Learning

Attention-Based Deep Reinforcement Learning for Qubit Allocation in Modular Quantum Architectures

Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving