Abstract:In heterogeneous wireless networks, when multiple nodes need to share the same wireless channel, they face the issue of multiple access, which necessitates a Medium Access Control (MAC) protocol to coordinate the data transmission of multiple nodes on the shared communication channel. This paper presents Proximal Policy Optimization-based Multiple Access (PPOMA), a novel multiple access protocol for heterogeneous wireless networks based on the Proximal Policy Optimization (PPO) algorithm from deep reinforcement learning (DRL). Specifically, we explore a network scenario where multiple nodes employ different MAC protocols to access an Access Point (AP). The novel PPOMA approach, leveraging deep reinforcement learning, adapts dynamically to coexist with other nodes. Without prior knowledge, it learns an optimal channel access strategy, aiming to maximize overall network throughput. We conduct simulation analyses using PPOMA in two scenarios: perfect channel and imperfect channel. Experimental results demonstrate that our proposed PPOMA continuously learns and refines its channel access strategy, achieving an optimal performance level in both perfect and imperfect channel scenarios. Even when faced with suboptimal channel conditions, PPOMA outperforms alternative methods by achieving higher overall network throughput and faster convergence rates. In a perfect channel scenario, PPOMA's advantage over other algorithms is primarily evident in its convergence speed, reaching convergence on average 500 iterations faster. In an imperfect channel scenario, PPOMA's advantage is mainly reflected in its higher overall network throughput, with an approximate increase of 0.04.

Online Multi-Agent Reinforcement Learning for Multiple Access in Wireless Networks

Intelligent Decentralized Multiple Access Via Multi- Agent Deep Reinforcement Learning

Multi-Agent Reinforcement Learning based Uplink OFDMA for IEEE 802.11ax Networks

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Multi-Agent Reinforcement Learning-Based Distributed Channel Access for Next Generation Wireless Networks

Continual MARL-assisted Traffic-Adaptive GC-MAC Protocol for Task-Driven Directional MANETs

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Heterogeneous Multi-Agent Reinforcement Learning for Distributed Channel Access in WLANs

Multiple Access for Heterogeneous Wireless Networks with Imperfect Channels Based on Deep Reinforcement Learning

Survey of Reinforcement-Learning-Based MAC Protocols for Wireless Ad Hoc Networks with a MAC Reference Model

Traffic-driven Spectrum and Power Allocation Via Scalable Multi-Agent Reinforcement Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Reinforcement learning based multi-parameter joint optimization in dense multi-hop wireless networks

Wireless MAC Protocol Synthesis and Optimization with Multi-Agent Distributed Reinforcement Learning

MA-CC: Cross-Layer Congestion Control via Multi-agent Reinforcement Learning

Multi-Access Point Coordination for Next-Gen Wi-Fi Networks Aided by Deep Reinforcement Learning

SMART: Situationally-Aware Multi-Agent Reinforcement Learning-Based Transmissions

Multi-Agent Reinforcement Learning for Dynamic Spectrum Access.

Scalable Joint Learning of Wireless Multiple-Access Policies and their Signaling

Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

Joint Spectrum and Power Allocation in Wireless Network: A Two-Stage Multi-Agent Reinforcement Learning Method