Abstract:With the rapid development of wireless communication networks, UAVs serving as base stations are increasingly being applied in various scenarios which not only include edge computation and task offloading, but also involve emergency communication, vehicular network enhancement, etc. In order to enhance the utility of UAV base stations’ allocation and deployment, a series of algorithms have been proposed, utilizing heuristic methods, learning-based algorithms or optimization approaches. However, it is intractable for current algorithms to handle the exponential computation increment with UAV base stations increasing, and complicated application scenarios with high dynamic demands. To solve the above issues, we formulate a decision problem with a long sequence to optimize the deployment of multi-UAV base stations for maximizing vehicular networks’ communication coverage ratio, which needs to be subject to co-constraints consisting of moving velocity, energy consumption and communication coverage radius. To solve this optimization problem, we creatively propose an algorithm named dense multi-agent reinforcement learning (DMARL), which is under the dual-layer nested decision-making framework, centralized training with decentralized deployment, and accelerates training by only collecting critical states into the dense sampling buffer. To prove our proposed algorithm’s effectiveness and generalization ability, we conduct experimental simulations in scenarios with different scales. Corresponding results have been provided to verify our algorithm’s superiority in training efficiency and performance metrics, including coverage ratio and energy consumption, compared with other algorithms.

Cooperative Planning of Multi-Uav Logistics Delivery by Multi-Graph Reinforcement Learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Graph Convolutional Multi-Agent Reinforcement Learning For Uav Coverage Control

Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning

Graph-Based Multi-agent Reinforcement Learning for Large-Scale UAVs Swarm System Control

Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning

Group-Based Deep Reinforcement Learning in Multi-UAV Confrontation

Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Multi-UAV Autonomous Path Planning in Reconnaissance Missions Considering Incomplete Information: A Reinforcement Learning Method

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Collaborative Coverage Path Planning of UAV Cluster based on Deep Reinforcement Learning

Dense Multi-Agent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks

Multi-Agent Reinforcement Learning for Unmanned Aerial Vehicle Coordination by Multi-Critic Policy Gradient Optimization

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

Deep Reinforcement Learning-based Collaborative Multi-UAV Coverage Path Planning

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

Graph Attention-based Reinforcement Learning for Trajectory Design and Resource Assignment in Multi-UAV Assisted Communication

Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

Unmanned Aerial Vehicle Cooperative Data Dissemination Based on Graph Neural Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach