Abstract:With the growing utilization of intelligent unmanned aerial vehicle (UAV) clusters in both military and civilian domains, the routing protocol of flying ad-hoc networks (FANETs) has promised a crucial role in facilitating cluster communication. However, the highly dynamic nature of the network topology, owing to the rapid movement and changing direction of aircraft nodes, as well as frequent accesses and exits from the network, has resulted in an increased interruption rate of FANETs links. While traditional protocols can satisfy basic network service quality (QoS) requirements in mobile ad-hoc networks (MANETs) with relatively fixed topology changes, they may fail to achieve optimal routes and consequently restrict information dissemination in FANETs with topology changes, which ultimately leads to elevated packet loss and delay. This paper undertakes an in-depth investigation of the challenges faced by current routing protocols in high dynamic topology scenarios, such as delay and packet loss. It proposes a Q-learning empowered highly dynamic, and latency-aware routing algorithm for flying ad-hoc networks (QEHLR). Traditional routing algorithms are unable to effectively route packets in highly dynamic FANETs; hence, this paper employs a Q-learning method to learn the link status in the network and effectively select routes through Q-values to avoid connection loss. Additionally, the remaining time of the link or path lifespan is incorporated into the routing protocol to construct the routing table. QEHLR can delete predicted failed links based on network status, thereby reducing packet loss caused by failed route selection. Simulations show that the enhanced algorithm significantly improves the packet transmission rate, which addresses the challenge of routing protocols' inability to adapt to various mobility scenarios in FANETs with dynamic topology by introducing a calculation factor based on the QEHLR protocol. The experimental results indicate that the improved routing algorithm achieves superior network performance.

Distributed Routing Optimization Algorithm for FANET Based on Multi-agent Reinforcement Learning

Topology-Aware Resilient Routing Protocol for FANETs: An Adaptive Q-Learning Approach

Reinforcement Learning based Energy-Efficient Fast Routing for FANETs

Deep-Reinforcement-Learning-Based Intelligent Routing Strategy for FANETs

QFAGR: A Q-learning-based Fast Adaptive Geographic Routing Protocol for Flying Ad Hoc Networks

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

Arithmetic Optimization AOMDV Routing Protocol for FANETs

Bidirectional Q-Learning Based Multi-objective Optimization Routing Protocol for Multi-Destination FANETs

QEHLR: A Q-Learning Empowered Highly Dynamic and Latency-Aware Routing Algorithm for Flying Ad-Hoc Networks

An adaptive intelligent routing algorithm based on deep reinforcement learning

Joint UAV Trajectory Scheduling and Network Routing for FANETs: A Reinforcement Learning Approach

A Novel Simulated Annealing Based Routing Algorithm in F-SDNs

A Dynamic and Local Perspective: A Reliable Q-Routing Protocol based on Fuzzy Logic for FANETs.

Q-adaptive: A Multi-Agent Reinforcement Learning Based Routing on Dragonfly Network

A Fuzzy Logic Reinforcement Learning-Based Routing Algorithm for Flying Ad Hoc Networks

DRL-AdCAR: Adaptive Coding-Aware Routing with Maximum Coding Opportunities and High-quality Via Deep Reinforcement Learning in FANET

Optimization of Computing Power Network Routing Strategies Based on Multi-Agent Soft Actor-Critic

Adaptive Routing Design for Flying Ad Hoc Networks: A Joint Prediction Approach

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET

Learning to Routing in UAV Swarm Network: A Multi-Agent Reinforcement Learning Approach

A Novel Optimized Link-State Routing Scheme with Greedy and Perimeter Forwarding Capability in Flying Ad Hoc Networks