Abstract:In this study, we examine the problem of downlink wireless routing in integrated access backhaul (IAB) networks involving fiber-connected base stations, wireless base stations, and multiple users. Physical constraints prevent the use of a central controller, leaving base stations with limited access to real-time network conditions. These networks operate in a time-slotted regime, where base stations monitor network conditions and forward packets accordingly. Our objective is to maximize the arrival ratio of packets, while simultaneously minimizing their latency. To accomplish this, we formulate this problem as a multi-agent partially observed Markov Decision Process (POMDP). Moreover, we develop an algorithm that uses Multi-Agent Reinforcement Learning (MARL) combined with Advantage Actor Critic (A2C) to derive a joint routing policy on a distributed basis. Due to the importance of packet destinations for successful routing decisions, we utilize information about similar destinations as a basis for selecting specific-destination routing decisions. For portraying the similarity between those destinations, we rely on their relational base-station associations, i.e., which base station they are currently connected to. Therefore, the algorithm is referred to as Relational Advantage Actor Critic (Relational A2C). To the best of our knowledge, this is the first work that optimizes routing strategy for IAB networks. Further, we present three types of training paradigms for this algorithm in order to provide flexibility in terms of its performance and throughput. Through numerical experiments with different network scenarios, Relational A2C algorithms were demonstrated to be capable of achieving near-centralized performance even though they operate in a decentralized manner in the network of interest. Based on the results of those experiments, we compare Relational A2C to other reinforcement learning algorithms, like Q-Routing and Hybrid Routing. This comparison illustrates that solving the joint optimization problem increases network efficiency and reduces selfish agent behavior.

Routing Without Routing Algorithms: an AI-Based Routing Paradigm for Multi-Domain Optical Networks

AI Routers & Network Mind: A Hybrid Machine Learning Paradigm for Packet Routing

A History-Based Inter-Domain Routing Algorithm in Multi-Domain Optical Networks

Inter-domain Routing Based on Simulated Annealing Algorithm in Optical Mesh Networks

Domain-Level-Based Routing Algorithm in Multidomain WDM Optical Network.

ADMIRE: Demonstration of Collaborative Data-Driven and Model-Driven Intelligent Routing Engine for IP/Optical Cross-Layer Optimization in X-Haul Networks

Analysis Of History-Based Inter-Domain Routing Algorithm In Multi-Domain Optical Networks

A Learning-Based Approach to Intra-Domain QoS Routing

Routing Algorithms for Packet/Circuit Switching in Optical Multi-Log(2)N Networks

An Outer-Roadm-Ring-Based Multi-Domain Routing Scheme In Optical Wdm Networks

Design of Federated Routing Mechanism in Cross-Domain Scenario

Routing Optimization Meets Machine Intelligence: A Perspective for the Future Network

A Routing Optimization Method for Software-Defined Optical Transport Networks Based on Ensembles and Reinforcement Learning

Poster Abstract: Always Heading for the Peak: Learning to Route with Domain Knowledge

Deep learning-optical network routing algorithm based on wavelength continuity supervision

Experimental Validation of Domain-Level Gradient-Based and Hierarchical Pce-Based Routing and Control in Heterogeneous Optical Networks

New heuristic algorithms for routing and wavelength assignment in large wavelength-routed optical networks

Optimization of Computing Power Network Routing Strategies Based on Multi-Agent Soft Actor-Critic

Multi domain optical network routing method based on edge ROADM (Reconfigurable Optical Add Drop Multiplexer) ring structure

Internet Intelligent Routing Architecture and Algorithm

Multi-agent reinforcement learning for network routing in integrated access backhaul networks