Abstract:The recent development of unmanned aerial vehicle (UAV) technology has shown the possibility of using UAVs in many research and industrial fields. One of them is for UAVs moving in swarms to provide wireless networks in environments where there is no network infrastructure. Although this method has the advantage of being able to provide a network quickly and at a low cost, it may cause scalability problems in multi-hop connectivity and UAV control when trying to cover a large area. Therefore, as more UAVs are used to form drone networks, the problem of efficiently controlling the network topology must be solved. To solve this problem, we propose a topology control system for drone networks, which analyzes relative positions among UAVs within a swarm, then optimizes connectivity among them in perspective of both interference and energy consumption, and finally reshapes a logical structure of drone networks by choosing neighbors per UAV and mapping data flows over them. The most important function in the scheme is the connectivity optimization because it should be adaptively conducted according to the dynamically changing complex network conditions, which includes network characteristics such as user density and UAV characteristics such as power consumption. Since neither a simple mathematical framework nor a network simulation tool for optimization can be a solution, we need to resort to reinforcement learning, specifically DDPG, with which each UAV can adjust its connectivity to other drones. In addition, the proposed system minimizes the learning time by flexibly changing the number of steps used for parameter learning according to the deployment of new UAVs. The performance of the proposed system was verified through simulation experiments and theoretical analysis on various topologies consisting of multiple UAVs.

Distributed Topology Control Based on Reinforcement Learning in Unmanned Aerial Vehicles Networks

Reinforcement Learning Based Topology Control for UAV Networks

Centroid-Guided Target-Driven Topology Control Method for UAV Ad-hoc Networks Based On Tiny Deep Reinforcement Learning Algorithm

Distributed Topology Control Based on Swarm Intelligence in Unmanned Aerial Vehicles Networks.

Joint Topology Construction and Power Adjustment for UAV Networks: A Deep Reinforcement Learning Based Approach

Service-Oriented Topology Reconfiguration of UAV Networks with Deep Reinforcement Learning

A New Rechargeable WSNs Based Multi-UAVs Network and Topology Control Algorithm

Distributed Cooperative Control for Deployment and Task Allocation of Unmanned Aerial Vehicle Networks

Topology Control Algorithm for UAV Ad Hoc Networks

Formation Flying and Obstacle Avoidance Control of UAV Cluster Based on Backbone Network

Formation control method of UAV cluster based on alliance

Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks

QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning

Communication-Efficient Topology Orchestration for Distributed Learning in UAV Networks

Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach

Clustering Strategy of UAV Network Based on Deep Q-learning

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Decentralized Trajectory and Power Control Based on Multi-Agent Deep Reinforcement Learning in UAV Networks

Distributed Hierarchical Control for Multiple Vertical Takeoff and Landing UAVs with a Distance‐based Network Topology

Multi-UAV Collaborative Surveillance Network Recovery Via Deep Reinforcement Learning

Leader-following flocking for unmanned aerial vehicle swarm with distributed topology control