Abstract:With the rapid development of wireless communication networks, UAVs serving as base stations are increasingly being applied in various scenarios which not only include edge computation and task offloading, but also involve emergency communication, vehicular network enhancement, etc. In order to enhance the utility of UAV base stations’ allocation and deployment, a series of algorithms have been proposed, utilizing heuristic methods, learning-based algorithms or optimization approaches. However, it is intractable for current algorithms to handle the exponential computation increment with UAV base stations increasing, and complicated application scenarios with high dynamic demands. To solve the above issues, we formulate a decision problem with a long sequence to optimize the deployment of multi-UAV base stations for maximizing vehicular networks’ communication coverage ratio, which needs to be subject to co-constraints consisting of moving velocity, energy consumption and communication coverage radius. To solve this optimization problem, we creatively propose an algorithm named dense multi-agent reinforcement learning (DMARL), which is under the dual-layer nested decision-making framework, centralized training with decentralized deployment, and accelerates training by only collecting critical states into the dense sampling buffer. To prove our proposed algorithm’s effectiveness and generalization ability, we conduct experimental simulations in scenarios with different scales. Corresponding results have been provided to verify our algorithm’s superiority in training efficiency and performance metrics, including coverage ratio and energy consumption, compared with other algorithms.

Density-aware deployment with multi-layer UAV-V2X communication networks

Communication and Trajectory Design in UAV-enabled Flying Network.

Enabling Ultra-Dense UAV-Aided Network with Overlapped Spectrum Sharing: Potential and Approaches.

Optimization of Multi-UAV-Aided Wireless Networking over a Ray-Tracing Channel Model

Adaptive Deployment for UAV-Aided Communication Networks

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

Low-Complexity Joint Resource Allocation and Trajectory Design for UAV-Aided Relay Networks With the Segmented Ray-Tracing Channel Model

Dense Multi-Agent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks

UAV Aided Network Association in Space-Air-Ground Communication Networks.

Joint Optimization of Relay Selection and Transmission Scheduling for UAV-Aided mmWave Vehicular Networks

Deep Q-Network Based Dynamic Movement Strategy in a UAV-Assisted Network

A UAV-Enabled Data Dissemination Protocol with Proactive Caching and File Sharing in V2X Networks

Performance Analysis and Optimization for V2V-assisted UAV Communications in Vehicular Networks

Joint Optimization of Relay Selection and Transmission Scheduling for UAV-Aided mm Wave Vehicular Networks

UAV-Assisted Data Dissemination Scheduling in VANETs

Network Resource Allocation for eMBB Payload and URLLC Control Information Communication Multiplexing in a Multi-UAV Relay Network

UAV-Aided Data Dissemination Protocol with Dynamic Trajectory Scheduling in VANETs.

Joint Deployment and Resource Allocation for Service Provision in Multi-UAV-Assisted Wireless Networks

Cellular UAV-to-X Communications: Design and Optimization for Multi-UAV Networks

Advancing reliability and efficiency of urban communication: Unmanned aerial vehicles, intelligent reflection surfaces, and deep learning techniques

An Energy-Efficient Intelligent Framework of UAV-Enhanced Vehicular Networks: Open Problems and a Case Study