Abstract:This article proposes a distributed MA‐IDDPG‐OLSR routing protocol that can adaptively adjust Hello and TC message sending cycles based on the speed of local topology changes in unmanned aerial vehicle ad hoc networks. This method can improve the QoS performance of unmanned aerial vehicle ad hoc networks in high dynamic networks. In unmanned aerial vehicle ad‐hoc network (UANET), the node speed of unmanned aerial vehicles (UAVs) may reach up to 400 km/h. The fast or slow movement of UAV nodes leads to different speeds of topology change of the nodes. Traditional optimized link state routing (OLSR) protocol cannot adaptively adjust the routing update period when the network topology changes, which may lead to the nodes calculating incorrect routing tables. This increases the average end‐to‐end delay and packet loss rate for packet transmission. To enhance the adaptability of OLSR routing protocol to network topology changes, this paper proposes a multi‐agent independent deep deterministic policy gradient‐OLSR (MA‐IDDPG‐OLSR) routing protocol based on distributed multi‐agent reinforcement learning. The protocol deploys DDPG algorithm on each UAV node, and each UAV node adaptively adjusts the Hello and TC message sending intervals, according to the one‐hop neighbouring nodes as well as its own state. Simulation results show that the proposed protocol is able to improve the throughput and reduce the packet loss rate as compared to traditional AODV, GRP, OLSR, and distributed multiple‐agent independent proximal policy optimization‐OLSR (MA‐IPPO‐OLSR), distributed multiple‐agent independent twin delayed deep deterministic policy gradient‐OLSR (MA‐ITD3‐OLSR) routing protocols. Since MA‐IDDPG‐OLSR relies only on local information, there is a minor performance degradation in MA‐IDDPG‐OLSR compared to centralized single‐agent DQN‐OLSR routing protocol. But it is more suitable to a completely distributed UAV network without a centralized node.

A Shortest Delay Routing Protocol Based on Time-Varying Graph for UAV Formation

Communication and Trajectory Design in UAV-enabled Flying Network.

A Multi-Agent Routing Algorithm with Trajectory Prediction for Highly Dynamic UAV Networks

Delay-Aware and Link-Quality-Aware Geographical Routing Protocol for UANET via Dueling Deep Q-Network

Multi-Objective Optimized GPSR Intelligent Routing Protocol for UAV Clusters

UAV Communication Network Modeling and Energy Consumption Optimization Based on Routing Algorithm

A Distributed Gateway Selection Algorithm for UAV Networks

Coordinated Path Following of UAVs using Event-Triggered Communication over Time-Varying Networks with Digraph Topologies

Self-Organization of UAV Networks for Maximizing Minimum Throughput of Ground Users

UAV-Aided Data Dissemination Protocol with Dynamic Trajectory Scheduling in VANETs.

Atraffic-aware Q-network Enhanced Routing Protocol Based Ongpsrfor Unmanned Aerial Vehicle Ad-Hoc Networks

UAV relay network deployment through the area with barriers

On Greedy Routing in Dynamic UAV Networks

A Flocking-Based on Demand Routing Protocol for Unmanned Aerial Vehicles

Research of Security Routing Protocol for UAV Communication Network Based on AODV

Packet Routing in Dynamic Multi-Hop UAV Relay Network: A Multi-Agent Learning Approach

Cube Based Space Region Partition Routing Algorithm in UAV Networks.

Efficient and Secure Routing Protocol Based on Artificial Intelligence Algorithms With UAV-Assisted for Vehicular Ad Hoc Networks in Intelligent Transportation Systems

Distributed MA‐IDDPG‐OLSR based stable routing protocol for unmanned aerial vehicle ad‐hoc network

Delay-Informed Intelligent Formation Control for UAV-Assisted IoT Application

Radio Environment Map Based Routing Protocol for UAV Networks