Abstract:With the growing utilization of intelligent unmanned aerial vehicle (UAV) clusters in both military and civilian domains, the routing protocol of flying ad-hoc networks (FANETs) has promised a crucial role in facilitating cluster communication. However, the highly dynamic nature of the network topology, owing to the rapid movement and changing direction of aircraft nodes, as well as frequent accesses and exits from the network, has resulted in an increased interruption rate of FANETs links. While traditional protocols can satisfy basic network service quality (QoS) requirements in mobile ad-hoc networks (MANETs) with relatively fixed topology changes, they may fail to achieve optimal routes and consequently restrict information dissemination in FANETs with topology changes, which ultimately leads to elevated packet loss and delay. This paper undertakes an in-depth investigation of the challenges faced by current routing protocols in high dynamic topology scenarios, such as delay and packet loss. It proposes a Q-learning empowered highly dynamic, and latency-aware routing algorithm for flying ad-hoc networks (QEHLR). Traditional routing algorithms are unable to effectively route packets in highly dynamic FANETs; hence, this paper employs a Q-learning method to learn the link status in the network and effectively select routes through Q-values to avoid connection loss. Additionally, the remaining time of the link or path lifespan is incorporated into the routing protocol to construct the routing table. QEHLR can delete predicted failed links based on network status, thereby reducing packet loss caused by failed route selection. Simulations show that the enhanced algorithm significantly improves the packet transmission rate, which addresses the challenge of routing protocols' inability to adapt to various mobility scenarios in FANETs with dynamic topology by introducing a calculation factor based on the QEHLR protocol. The experimental results indicate that the improved routing algorithm achieves superior network performance.

A Q-Learning-Based Fault-Tolerant and Congestion-Aware Adaptive Routing Algorithm for Networks-on-Chip

Adaptive Ant-Based Dynamic Routing Algorithm

A Q-routing Based Self-regulated Routing Scheme for Network-on-Chip

Fault-Tolerant Networks-on-Chip Routing with Coarse and Fine-Grained Look-Ahead

A Congestion-Adaptive Fault-Tolerant Routing Algorithm On Hnoc

Design and Optimization of a Fault-Tolerant Deflection Router for Networks-on-Chip

A Fault-Tolerant Network-on-chip Design Using Dynamic Reconfiguration of Partial-Faulty Routing Resources

Fault-tolerant Routing for On-Chip Network Without Using Virtual Channels

A Deterministic-Path Routing Algorithm for Tolerating Many Faults on Very-Large-Scale Network-on-Chip

A Traffic-Aware Adaptive Routing Algorithm on A Highly Reconfigurable Network-On-Chip Architecture

Network on Chip-based Fault Tolerant Routing Algorithm and Its Implementation

A Novel Adaptive Routing Algorithm For Network-On-Chip

QEHLR: A Q-Learning Empowered Highly Dynamic and Latency-Aware Routing Algorithm for Flying Ad-Hoc Networks

A Fault-Tolerant Deflection Routing for Network-on-Chip

Fault-Tolerant Routing Algorithm Simulation and Hardware Verification of NoC

Adaptive Routing Algorithms for Lifetime Reliability Optimization in Network-on-Chip.

An Energy-Aware Network Routing Algorithm Based on Q-Learning

A Fault-Tolerant Routing Algorithm Using Tunnels in Fault Blocks for Network-on-Chip

Highly Resilient Minimal Path Routing Algorithm for Fault Tolerant Network-on-Chips

TTQR: A Traffic- and Thermal-Aware Q-Routing for 3D Network-on-Chip

A Runtime Fault-Tolerant Routing Algorithm Based on Region Flooding in NoCs.