Distributed Topology Control Based on Reinforcement Learning in Unmanned Aerial Vehicles Networks
Xiaoyang Fang,Jinsong Kuang,Peng Zhang,Ting Zhao,Han Ding,Wei Hu
DOI: https://doi.org/10.1117/12.3025339
2024-01-01
Abstract:The fast development and restricted energy qualities of Unmanned Aerial Vehicles (UAVs) lead to visit changes in the topology of UAV networks, to adapt to this present circumstance, this paper proposes a distributed topology control based on reinforcement learning in unmanned aerial vehicles networks. Neighbor discovery, Election of cluster heads, establishment of clusters, and cluster maintenance are carried out based on parameters such as UAV survival time, connectivity and link stability time. Reinforcement learning method is used to determine the optimal cluster reconfiguration strategy. For every parameter used in CH election, a set of appropriate weights is determined by the maintenance approach to preserve a stable network topology and extend the network lifetime. The strategies are rewarded based on how well they perform on the network. The mechanism proposed in this research was assessed by contrasting it with three topology construction methods, K-means, DCM and MMF. The results show that the method in this paper is applicable to UAV networks with different degrees of improvement in topology maintenance time, packet delivery ratio, end-to-end delay, network throughput, and average node survival time.