Abstract:Without control center assistance, it is difficult that users take traffic loads of whole Ad Hoc networks into account to utilize wireless resources collaboratively. Considering influence of load differences between users on resource allocation can be learned in advance, we construct a framework of load-aware distributed resource allocation for multiple frequencies time division multiple access (MF-TDMA) wireless Ad Hoc networks based on multi-agent deep reinforcement learning (DRL) with centralized training and distributed execution. In this framework, each user is regarded as an agent and the wireless transmission resources are partitioned into time-frequency resource blocks (RBs). Each user reserves RBs by sending network manager operational packet (NMOP) in turn at rotating broadcast stage (RBS) and how many RBs each user reserves depends on the corresponding agent's decision. The main innovative point of our work is achieving a result of wireless resource allocation that balance load degree of all users on the whole network in a distributed manner. With defining a novel network utility parameterized by traffic loads (termed timely capacity), we first model the resource allocation as an optimization problem for timely capacity sum maximization. Using the optimization objective as common reward function to train neural networks of all agents in an offline simulation environment, we obtain the distributed algorithm based on multi-agent DRL. Experimental results demonstrate that with the neural networks trained by the designed reward and enough training, users can successfully learn to collaboratively improve network utility in distributed implementation.

Distributed Interference Coordination Based on Multi-Agent Deep Reinforcement Learning

A Multi-agent Formation Control Algorithm in Interference Environment

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

A distributed algorithm for signal coordination of multiple agents with embedded platoon dispersion model

Distributed and Coordinated Multi-Agent Learning for Resource Allocation in Vehicular Networks

Cooperative Traffic Signal Control Using a Distributed Agent-Based Deep Reinforcement Learning With Incentive Communication

Intelligent Resource Allocation for Train-to-Train Communication: A Multi-Agent Deep Reinforcement Learning Approach.

Multi-Agent Deep Reinforcement Learning Based Spectrum Allocation for D2D Underlay Communications.

Load-Aware Distributed Resource Allocation for MF-TDMA Ad Hoc Networks: A Multi-Agent DRL Approach.

Reinforcement Learning Based Interference Coordination for Port Communications

A Distributed Learning-based Interference Coordination and Resource Allocation Scheme.

D2D Communication Resource Allocation Algorithm Based on Multi-Agent Reinforcement Learning

A Method for Multi-Agent Coordination Based on Distributed Reinforcement Learning

Multi-Agent Reinforcement Learning Based Distributed Transmission in Collaborative Cloud-Edge Systems.

Multi-agent Deep Reinforcement Learning for Cross-Layer Scheduling in Mobile Ad-Hoc Networks

Collaborative Optimization of Wireless Communication and Computing Resource Allocation based on Multi-Agent Federated Weighting Deep Reinforcement Learning

Multi-agent Deep Reinforcement Learning Strategy for Distributed Energy

Distributed Signal Control of Arterial Corridors Using Multi-Agent Deep Reinforcement Learning

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning

Game Theory and Multi-Agent DRL Based Anti-Jamming Transmission for Integrated Air-Ground Network