Abstract:In the next generation wireless networks, more applications will emerge, covering virtual reality movies, augmented reality, holographic three-dimensional telepresence, haptic telemedicine and so on, which require the provisioning of high bandwidth efficiency and low latency services. In order to better support the aforementioned applications and services, novel distributed channel access (DCA) schemes are necessary. Therefore, we propose a new MAC protocol, QMIX-advanced Listen-Before-Talk (QLBT), based on the cutting-edge multi-agent reinforcement learning (MARL) algorithm. It employs a centralized training with decentralized execution (CTDE) framework to exploit the overall information of all agents during training, and ensure that each agent can independently infer the optimal channel access behavior based on its local observation. We enhance QMIX, a well-known MARL algorithm, by introducing an extra individual Q-value for each agent in the mixing network apart from the original total Q-value, which makes QLBT more stable. Moreover, delay to last successful transmission (D2LT) is first introduced in this work as a part of the observations of each QLBT agent, which facilitates agents to reach a cooperative policy that prioritizes the agent with the longest delay. Finally, extensive simulation experiments are provided to show that the proposed QLBT algorithm: 1) outperforms CSMA/CA and even its theoretical performance bound in various scenarios including saturated traffic, unsaturated traffic and delay-sensitive traffic; 2) is robust in dynamic environment; and 3) is able to friendly coexist with “legacy” CSMA/CA stations.

Q-CF Multi-Agent Reinforcement Learning for Resource Allocation Problems

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Learning Intra-group Cooperation in Multi-agent Systems.

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

A Multi-Agent Reinforcement Learning Algorithm Based on Stackelberg Game

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

QoS Optimization for Mobile Ad Hoc Cloud: A Multi-Agent Independent Learning Approach

Genetic Algorithm Based Resource Management for Cognitive Mesh Networks with Real-time and Non-real-time Services

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

A novel multi-agent Q-learning algorithm in cooperative multi-agent system

QoE-based Deep Reinforcement Learning for Resource Allocation in Real Time XR Video Transmission

Deep Multiagent Reinforcement-Learning-Based Resource Allocation for Internet of Controllable Things

A Novel Multi-Agent Reinforcement Learning Approach

A Cooperative Multi-Agent Reinforcement Learning Framework for Resource Balancing in Complex Logistics Network

Adaptive Individual Q-Learning-A Multiagent Reinforcement Learning Method for Coordination Optimization

A new multi-agent reinforcement learning approach

A Cooperation-Free Resource Allocation Algorithm Enhanced by Reinforcement Learning for Coexisting IIoTs

Enhancing cooperation by cognition differences and consistent representation in multi-agent reinforcement learning

Multi-Agent Reinforcement Learning for Long-Term Network Resource Allocation through Auction: a V2X Application

Multi-Agent Reinforcement Learning-Based Distributed Channel Access for Next Generation Wireless Networks

Multiagent Q-learning with Sub-Team Coordination.