Abstract:In this study, we examine the problem of downlink wireless routing in integrated access backhaul (IAB) networks involving fiber-connected base stations, wireless base stations, and multiple users. Physical constraints prevent the use of a central controller, leaving base stations with limited access to real-time network conditions. These networks operate in a time-slotted regime, where base stations monitor network conditions and forward packets accordingly. Our objective is to maximize the arrival ratio of packets, while simultaneously minimizing their latency. To accomplish this, we formulate this problem as a multi-agent partially observed Markov Decision Process (POMDP). Moreover, we develop an algorithm that uses Multi-Agent Reinforcement Learning (MARL) combined with Advantage Actor Critic (A2C) to derive a joint routing policy on a distributed basis. Due to the importance of packet destinations for successful routing decisions, we utilize information about similar destinations as a basis for selecting specific-destination routing decisions. For portraying the similarity between those destinations, we rely on their relational base-station associations, i.e., which base station they are currently connected to. Therefore, the algorithm is referred to as Relational Advantage Actor Critic (Relational A2C). To the best of our knowledge, this is the first work that optimizes routing strategy for IAB networks. Further, we present three types of training paradigms for this algorithm in order to provide flexibility in terms of its performance and throughput. Through numerical experiments with different network scenarios, Relational A2C algorithms were demonstrated to be capable of achieving near-centralized performance even though they operate in a decentralized manner in the network of interest. Based on the results of those experiments, we compare Relational A2C to other reinforcement learning algorithms, like Q-Routing and Hybrid Routing. This comparison illustrates that solving the joint optimization problem increases network efficiency and reduces selfish agent behavior.

Using Statistical Network Link Model for Routing in Ad Hoc Networks with Multi-Agent Reinforcement Learning

Performance Comparison and Analysis of Routing Strategies in Mobile Ad Hoc Networks

An adaptive intelligent routing algorithm based on deep reinforcement learning

QoS Sensitive Routing Algorithm with Link Quality Prediction in SDN-based Ad Hoc Networks

Topology Control Mechanism Based on Link Available Probability in Aeronautical Ad Hoc Network.

A Modified Multi-Agent Reinforcement Learning Protocol Based on Prediction for UAANETs

Reinforcement Learning Empowered QoS-aware Adaptive Q-Routing in Ad-hoc Networks.

Decentralized Routing and Radio Resource Allocation in Wireless Ad Hoc Networks via Graph Reinforcement Learning

Multi-agent reinforcement learning for network routing in integrated access backhaul networks

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET

Real-time routing algorithm for mobile ad hoc networks using reinforcement learning and heuristic algorithms

Link availability estimation based reliable routing for aeronautical ad hoc networks

An Opportunistic Routing Protocol based on Link Quality and Local Topology in Mobile Ad hoc Networks

Multiagent Meta-Reinforcement Learning for Adaptive Multipath Routing Optimization

Link Availability Prediction-Based Reliable Routing for Mobile Ad Hoc Networks

On Performance of Routing Schemes in Mobile Ad hoc Network

A Link Reliability-Aware Route Maintenance Mechanism for Mobile Ad Hoc Networks

Towards Sensitive Link Quality Prediction in Ad Hoc Routing Protocol Based on Grey Theory.

Reinforcement Learning Based Mobility Adaptive Routing for Vehicular Ad-Hoc Networks

Reinforcement Learning-Based Adaptive Stateless Routing for Ambient Backscatter Wireless Sensor Networks

Realization of Route Reconstructing Scheme for Mobile Ad Hoc Network.