Abstract:Modular, distributed and multi-core architectures are currently considered a promising approach for scalability of quantum computing systems. The integration of multiple Quantum Processing Units necessitates classical and quantum-coherent communication, introducing challenges related to noise and quantum decoherence in quantum state transfers between cores. Optimizing communication becomes imperative, and the compilation and mapping of quantum circuits onto physical qubits must minimize state transfers while adhering to architectural constraints. The compilation process, inherently an NP-hard problem, demands extensive search times even with a small number of qubits to be solved to optimality. To address this challenge efficiently, we advocate for the utilization of heuristic mappers that can rapidly generate solutions. In this work, we propose a novel approach employing Deep Reinforcement Learning (DRL) methods to learn these heuristics for a specific multi-core architecture. Our DRL agent incorporates a Transformer encoder and Graph Neural Networks. It encodes quantum circuits using self-attention mechanisms and produce outputs through an attention-based pointer mechanism that directly signifies the probability of matching logical qubits with physical cores. This enables the selection of optimal cores for logical qubits efficiently. Experimental evaluations show that the proposed method can outperform baseline approaches in terms of reducing inter-core communications and minimizing online time-to-solution. This research contributes to the advancement of scalable quantum computing systems by introducing a novel learning-based heuristic approach for efficient quantum circuit compilation and mapping.

Casting Rubik’s Group into a Unitary Representation for Reinforcement Learning

Solving Rubik’s cube via quantum mechanics and deep reinforcement learning

Solving the Rubik’s cube with deep reinforcement learning and search

Attention-Based Deep Reinforcement Learning for Qubit Allocation in Modular Quantum Architectures

Solving Rubik's Cube with a Robot Hand

Towards Learning Rubik's Cube with N-tuple-based Reinforcement Learning

Solving a Rubik's Cube Using its Local Graph Structure

Reinforcement Learning to Disentangle Multiqubit Quantum States from Partial Observations

Solving Rubik's Cube Without Tricky Sampling

Quantum permutation puzzles with indistinguishable particles

Understanding Energy Level Structure Using Quantum Rubik's Cube

Understanding Energy-Level Structure Using a Quantum Rubik's Cube

From Easy to Hard: Tackling Quantum Problems with Learned Gadgets For Real Hardware

Topological Quantum Compiling with Reinforcement Learning

A reinforcement learning approach for quantum state engineering

On Solving the Rubik's Cube with Domain-Independent Planners Using Standard Representations

Unitary Synthesis of Clifford+T Circuits with Reinforcement Learning

Learning to Solve a Rubik’s Cube with a Dexterous Hand

Solving Extra-High-Order Rubik'S Cube Problem by A Dynamic Simulated Annealing

Learning to Solve a Rubik's Cube with a Dexterous Hand

Compilation of product-formula Hamiltonian simulation via reinforcement learning