Abstract:Collaboration is a key challenge in distributed multi-agent reinforcement learning (MARL) environments. Learning frameworks for these decentralized systems must weigh the benefits of explicit player coordination against the communication overhead and computational cost of sharing local observations and environmental data. Quantum computing has sparked a potential synergy between quantum entanglement and cooperation in multi-agent environments, which could enable more efficient distributed collaboration with minimal information sharing. This relationship is largely unexplored, however, as current state-of-the-art quantum MARL (QMARL) implementations rely on classical information sharing rather than entanglement over a quantum channel as a coordination medium. In contrast, in this paper, a novel framework dubbed entangled QMARL (eQMARL) is proposed. The proposed eQMARL is a distributed actor-critic framework that facilitates cooperation over a quantum channel and eliminates local observation sharing via a quantum entangled split critic. Introducing a quantum critic uniquely spread across the agents allows coupling of local observation encoders through entangled input qubits over a quantum channel, which requires no explicit sharing of local observations and reduces classical communication overhead. Further, agent policies are tuned through joint observation-value function estimation via joint quantum measurements, thereby reducing the centralized computational burden. Experimental results show that eQMARL with ${\Psi}^{+}$ entanglement converges to a cooperative strategy up to $17.8\%$ faster and with a higher overall score compared to split classical and fully centralized classical and quantum baselines. The results also show that eQMARL achieves this performance with a constant factor of $25$-times fewer centralized parameters compared to the split classical baseline.

Software Simulation and Visualization of Quantum Multi-Drone Reinforcement Learning

Quantum Multi-Agent Reinforcement Learning for Aerial Ad-hoc Networks

Quantum Multi-Agent Reinforcement Learning for Autonomous Mobility Cooperation

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Quantum Multi-Agent Actor-Critic Networks for Cooperative Mobile Access in Multi-UAV Systems

QuadSwarm: A Modular Multi-Quadrotor Simulator for Deep Reinforcement Learning with Direct Thrust Control

High-Sample-Efficient Multiagent Reinforcement Learning for Navigation and Collision Avoidance of UAV Swarms in Multitask Environments

On the convergence of projective-simulation-based reinforcement learning in Markov decision processes

Trends in quantum reinforcement learning: State‐of‐the‐arts and the road ahead

Quantum Machine Learning Architecture Search via Deep Reinforcement Learning

Quantum Multi-Agent Reinforcement Learning is All You Need: Coordinated Global Access in Integrated TN/NTN Cube-Satellite Networks

Quantum Computing and Neuromorphic Computing for Safe, Reliable, and explainable Multi-Agent Reinforcement Learning: Optimal Control in Autonomous Robotics

Quantum-Inspired Reinforcement Learning for Quantum Control

MQE: Unleashing the Power of Interaction with Multi-agent Quadruped Environment

Model-aided Federated Reinforcement Learning for Multi-UAV Trajectory Planning in IoT Networks

Cooperative Multi-UAV Dynamic Anti-Jamming Scheme with Deep Reinforcement Learning.

eQMARL: Entangled Quantum Multi-Agent Reinforcement Learning for Distributed Cooperation over Quantum Channels

A Distributed Simulation-to-Reality Transfer Framework for Multi-agent Reinforcement Learning

An evolutionary multi-agent reinforcement learning algorithm for multi-UAV air combat

Brain-Inspired Agents for Quantum Reinforcement Learning

Dynamic Inhomogeneous Quantum Resource Scheduling with Reinforcement Learning