Abstract:This article proposes a distributed MA‐IDDPG‐OLSR routing protocol that can adaptively adjust Hello and TC message sending cycles based on the speed of local topology changes in unmanned aerial vehicle ad hoc networks. This method can improve the QoS performance of unmanned aerial vehicle ad hoc networks in high dynamic networks. In unmanned aerial vehicle ad‐hoc network (UANET), the node speed of unmanned aerial vehicles (UAVs) may reach up to 400 km/h. The fast or slow movement of UAV nodes leads to different speeds of topology change of the nodes. Traditional optimized link state routing (OLSR) protocol cannot adaptively adjust the routing update period when the network topology changes, which may lead to the nodes calculating incorrect routing tables. This increases the average end‐to‐end delay and packet loss rate for packet transmission. To enhance the adaptability of OLSR routing protocol to network topology changes, this paper proposes a multi‐agent independent deep deterministic policy gradient‐OLSR (MA‐IDDPG‐OLSR) routing protocol based on distributed multi‐agent reinforcement learning. The protocol deploys DDPG algorithm on each UAV node, and each UAV node adaptively adjusts the Hello and TC message sending intervals, according to the one‐hop neighbouring nodes as well as its own state. Simulation results show that the proposed protocol is able to improve the throughput and reduce the packet loss rate as compared to traditional AODV, GRP, OLSR, and distributed multiple‐agent independent proximal policy optimization‐OLSR (MA‐IPPO‐OLSR), distributed multiple‐agent independent twin delayed deep deterministic policy gradient‐OLSR (MA‐ITD3‐OLSR) routing protocols. Since MA‐IDDPG‐OLSR relies only on local information, there is a minor performance degradation in MA‐IDDPG‐OLSR compared to centralized single‐agent DQN‐OLSR routing protocol. But it is more suitable to a completely distributed UAV network without a centralized node.

A Modified Multi-Agent Reinforcement Learning Protocol Based on Prediction for UAANETs

Improving Routing in Networks of UAVs Via Scoped Flooding and Mobility Prediction

Enhancing the RGR Routing Protocol for Unmanned Aeronautical Ad-hoc Networks

A Bidirectional Q-learning Routing Protocol for UAV Networks

Improving Routing In Networks Of Unmanned Aerial Vehicles: Reactive-Greedy-Reactive

A Multi-agent Reinforcement Learning Routing Protocol in Mobile Robot Network

Enhancements to Reduce the Overhead of the Reactive-Greedy-Reactive Routing Protocol for Unmanned Aeronautical Ad-Hoc Networks

DDQN with Prioritized Experience Replay-Based Optimized Geographical Routing Protocol of Considering Link Stability and Energy Prediction for UANET

A Mobility Prediction and Delay Prediction Routing Protocol for UAV Networks

Reinforcement Learning Based Mobility Adaptive Routing for Vehicular Ad-Hoc Networks

Delay-Aware and Link-Quality-Aware Geographical Routing Protocol for UANET via Dueling Deep Q-Network

Distributed MA‐IDDPG‐OLSR based stable routing protocol for unmanned aerial vehicle ad‐hoc network

Distributed Routing Optimization Algorithm for FANET Based on Multi-agent Reinforcement Learning

Using Statistical Network Link Model for Routing in Ad Hoc Networks with Multi-Agent Reinforcement Learning

An Enhanced Q-Learning Routing Algorithm Based on Trajectory Prediction for UAV Networks.

A Multi-Agent Reinforcement Learning Routing Protocol for Underwater Optical Sensor Networks

QAAR: an Application-Adaptive Routing Protocol Based on Q-Learning in Underwater Sensor Networks

Reinforcement Learning Empowered QoS-aware Adaptive Q-Routing in Ad-hoc Networks.

QFAGR: A Q-learning-based Fast Adaptive Geographic Routing Protocol for Flying Ad Hoc Networks

An adaptive intelligent routing algorithm based on deep reinforcement learning

Mobility Prediction Based Virtual Routing for Ad Hoc UAV Network.