Abstract:With the growing utilization of intelligent unmanned aerial vehicle (UAV) clusters in both military and civilian domains, the routing protocol of flying ad-hoc networks (FANETs) has promised a crucial role in facilitating cluster communication. However, the highly dynamic nature of the network topology, owing to the rapid movement and changing direction of aircraft nodes, as well as frequent accesses and exits from the network, has resulted in an increased interruption rate of FANETs links. While traditional protocols can satisfy basic network service quality (QoS) requirements in mobile ad-hoc networks (MANETs) with relatively fixed topology changes, they may fail to achieve optimal routes and consequently restrict information dissemination in FANETs with topology changes, which ultimately leads to elevated packet loss and delay. This paper undertakes an in-depth investigation of the challenges faced by current routing protocols in high dynamic topology scenarios, such as delay and packet loss. It proposes a Q-learning empowered highly dynamic, and latency-aware routing algorithm for flying ad-hoc networks (QEHLR). Traditional routing algorithms are unable to effectively route packets in highly dynamic FANETs; hence, this paper employs a Q-learning method to learn the link status in the network and effectively select routes through Q-values to avoid connection loss. Additionally, the remaining time of the link or path lifespan is incorporated into the routing protocol to construct the routing table. QEHLR can delete predicted failed links based on network status, thereby reducing packet loss caused by failed route selection. Simulations show that the enhanced algorithm significantly improves the packet transmission rate, which addresses the challenge of routing protocols' inability to adapt to various mobility scenarios in FANETs with dynamic topology by introducing a calculation factor based on the QEHLR protocol. The experimental results indicate that the improved routing algorithm achieves superior network performance.

An Energy-Aware Network Routing Algorithm Based on Q-Learning

An Intelligent Approach to Energy Efficient Transportation and QoS Routing

Energy-Saving Adaptive Routing for High-Speed Railway Monitoring Network Based on Improved Q Learning

A Q-Learning-Based Routing Approach for Energy Efficient Information Transmission in Wireless Sensor Network

A QoE-based Dynamic Energy-Efficient Network Selection Algorithm

Reinforcement Learning Empowered QoS-aware Adaptive Q-Routing in Ad-hoc Networks.

QEHLR: A Q-Learning Empowered Highly Dynamic and Latency-Aware Routing Algorithm for Flying Ad-Hoc Networks

Traffic Measurement Optimization Based on Reinforcement Learning in Large-Scale IP Backbone Networks

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

A Q-Learning-Based Fault-Tolerant and Congestion-Aware Adaptive Routing Algorithm for Networks-on-Chip

Energy-Efficient Routing and Rate Allocation for Delay Tolerant Networks

QEBR: Q-Learning Based Routing Protocol for Energy Balance in Wireless Mesh Networks

Topology-Aware Resilient Routing Protocol for FANETs: An Adaptive Q-Learning Approach

DQN-based Energy-Efficient Routing Algorithm in Software-Defined Data Centers

An Energy Aware Cellular Learning Automata Based Routing Algorithm for Opportunistic Networks

An Energy-Aware Ant Colony Optimization Routing Algorithm in the Private Network

A Q-routing Based Self-regulated Routing Scheme for Network-on-Chip

Q-Learning Based and Energy-Aware Multipath Congestion Control in Mobile Wireless Network

Adaptive and Robust Network Routing Based on Deep Reinforcement Learning with Lyapunov Optimization.

QoE-Oriented Routing Mixing Application KPIs and Link Metrics Through Machine Learning

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET