Abstract:The recent development of unmanned aerial vehicle (UAV) technology has shown the possibility of using UAVs in many research and industrial fields. One of them is for UAVs moving in swarms to provide wireless networks in environments where there is no network infrastructure. Although this method has the advantage of being able to provide a network quickly and at a low cost, it may cause scalability problems in multi-hop connectivity and UAV control when trying to cover a large area. Therefore, as more UAVs are used to form drone networks, the problem of efficiently controlling the network topology must be solved. To solve this problem, we propose a topology control system for drone networks, which analyzes relative positions among UAVs within a swarm, then optimizes connectivity among them in perspective of both interference and energy consumption, and finally reshapes a logical structure of drone networks by choosing neighbors per UAV and mapping data flows over them. The most important function in the scheme is the connectivity optimization because it should be adaptively conducted according to the dynamically changing complex network conditions, which includes network characteristics such as user density and UAV characteristics such as power consumption. Since neither a simple mathematical framework nor a network simulation tool for optimization can be a solution, we need to resort to reinforcement learning, specifically DDPG, with which each UAV can adjust its connectivity to other drones. In addition, the proposed system minimizes the learning time by flexibly changing the number of steps used for parameter learning according to the deployment of new UAVs. The performance of the proposed system was verified through simulation experiments and theoretical analysis on various topologies consisting of multiple UAVs.

Service-Oriented Topology Reconfiguration of UAV Networks with Deep Reinforcement Learning

Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches

Distributed Topology Control Based on Reinforcement Learning in Unmanned Aerial Vehicles Networks

Joint Topology Construction and Power Adjustment for UAV Networks: A Deep Reinforcement Learning Based Approach

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Centroid-Guided Target-Driven Topology Control Method for UAV Ad-hoc Networks Based On Tiny Deep Reinforcement Learning Algorithm

Multi-UAV Trajectory Design and Power Control Based on Deep Reinforcement Learning.

QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning Based UAV Trajectory Optimization for Differentiated Services

Deep Reinforcement Learning-enabled Dynamic UAV Deployment and Power Control in Multi-UAV Wireless Networks

Decentralized Trajectory and Power Control Based on Multi-Agent Deep Reinforcement Learning in UAV Networks

Multi-UAV Dynamic Wireless Networking with Deep Reinforcement Learning

Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network

UAV Position Optimization for Servicing Ground Users Based on Deep Reinforcement Learning

Autonomous Deployment and Energy Efficiency Optimization Strategy of UAV Based on Deep Reinforcement Learning

Reinforcement Learning Based Topology Control for UAV Networks

Research on the UAV-aided Data Collection and Trajectory Design Based on the Deep Reinforcement Learning

Joint Optimization of Multi-UAV Deployment and User Association Via Deep Reinforcement Learning for Long-Term Communication Coverage

Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning

Joint Optimization of Multi-UAV-Assisted Data Collection and Energy Replenishment Via Transfer Learning Aided Deep Reinforcement Learning

Multi-UAV Collaborative Surveillance Network Recovery Via Deep Reinforcement Learning