Abstract:With the rapid development of wireless communication networks, UAVs serving as base stations are increasingly being applied in various scenarios which not only include edge computation and task offloading, but also involve emergency communication, vehicular network enhancement, etc. In order to enhance the utility of UAV base stations’ allocation and deployment, a series of algorithms have been proposed, utilizing heuristic methods, learning-based algorithms or optimization approaches. However, it is intractable for current algorithms to handle the exponential computation increment with UAV base stations increasing, and complicated application scenarios with high dynamic demands. To solve the above issues, we formulate a decision problem with a long sequence to optimize the deployment of multi-UAV base stations for maximizing vehicular networks’ communication coverage ratio, which needs to be subject to co-constraints consisting of moving velocity, energy consumption and communication coverage radius. To solve this optimization problem, we creatively propose an algorithm named dense multi-agent reinforcement learning (DMARL), which is under the dual-layer nested decision-making framework, centralized training with decentralized deployment, and accelerates training by only collecting critical states into the dense sampling buffer. To prove our proposed algorithm’s effectiveness and generalization ability, we conduct experimental simulations in scenarios with different scales. Corresponding results have been provided to verify our algorithm’s superiority in training efficiency and performance metrics, including coverage ratio and energy consumption, compared with other algorithms.

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

UAV Cooperative Search Based on Multi-agent Generative Adversarial Imitation Learning

UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning

Multi-UAV Collaborative Search and Strike based on Reinforcement Learning

MW-MADDPG: a meta-learning based decision-making method for collaborative UAV swarm

Enhancing multi-UAV air combat decision making via hierarchical reinforcement learning

UAV Swarm Confrontation Using Hierarchical Multiagent Reinforcement Learning

Group-Based Deep Reinforcement Learning in Multi-UAV Confrontation

Multi-Uav Automatic Dynamic Obstacle Avoidance With Experience-Shared A2c

An evolutionary multi-agent reinforcement learning algorithm for multi-UAV air combat

Digital Twin-Enabled Decision-Making Framework for Multi-UAV Mission Planning: A Multiagent Deep Reinforcement Learning Perspective

Large-scale UAV swarm confrontation based on hierarchical attention actor-critic algorithm

Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Multi-Agent Reinforcement Learning for Unmanned Aerial Vehicle Coordination by Multi-Critic Policy Gradient Optimization

Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning

Dense Multi-Agent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks