Abstract:In this study, we examine the problem of downlink wireless routing in integrated access backhaul (IAB) networks involving fiber-connected base stations, wireless base stations, and multiple users. Physical constraints prevent the use of a central controller, leaving base stations with limited access to real-time network conditions. These networks operate in a time-slotted regime, where base stations monitor network conditions and forward packets accordingly. Our objective is to maximize the arrival ratio of packets, while simultaneously minimizing their latency. To accomplish this, we formulate this problem as a multi-agent partially observed Markov Decision Process (POMDP). Moreover, we develop an algorithm that uses Multi-Agent Reinforcement Learning (MARL) combined with Advantage Actor Critic (A2C) to derive a joint routing policy on a distributed basis. Due to the importance of packet destinations for successful routing decisions, we utilize information about similar destinations as a basis for selecting specific-destination routing decisions. For portraying the similarity between those destinations, we rely on their relational base-station associations, i.e., which base station they are currently connected to. Therefore, the algorithm is referred to as Relational Advantage Actor Critic (Relational A2C). To the best of our knowledge, this is the first work that optimizes routing strategy for IAB networks. Further, we present three types of training paradigms for this algorithm in order to provide flexibility in terms of its performance and throughput. Through numerical experiments with different network scenarios, Relational A2C algorithms were demonstrated to be capable of achieving near-centralized performance even though they operate in a decentralized manner in the network of interest. Based on the results of those experiments, we compare Relational A2C to other reinforcement learning algorithms, like Q-Routing and Hybrid Routing. This comparison illustrates that solving the joint optimization problem increases network efficiency and reduces selfish agent behavior.

A Multi-Agent Dueling DQN based Route Selection Scheme for IAB Congestion Controlling

Slicing Resource Allocation Based on Dueling DQN for eMBB and URLLC Hybrid Services in Heterogeneous Integrated Networks

Deep Reinforcement Learning-based Spectrum Allocation and Power Management for IAB Networks

Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET

Joint Design of Access and Backhaul in Densely Deployed MmWave Small Cells

Traffic Priority-Aware Multi-User Distributed Dynamic Spectrum Access: A Multi-Agent Deep RL Approach

A Dueling Deep Recurrent Q -Network Framework for Dynamic Multichannel Access in Heterogeneous Wireless Networks

Mobility-Aware Resource Allocation for mmWave IAB Networks: A Multi-Agent Reinforcement Learning Approach

Multi Agent DeepRL based Joint Power and Subchannel Allocation in IAB networks

Deep-Reinforcement-Learning-Based Resource Allocation in ultra-dense network.

Decentralized Multi-Agent DQN-Based Resource Allocation for Heterogeneous Traffic in V2X Communications

DQN Based Anti-blocking Routing Algorithm for IRS-assisted MANET

Multi-agent reinforcement learning for network routing in integrated access backhaul networks

MA-CC: Cross-Layer Congestion Control via Multi-agent Reinforcement Learning

Multi-Agent Deep Reinforcement Learning Based Spectrum Allocation for D2D Underlay Communications.

A Joint Resource Allocation Method of D2D Communication Resources Based on Multi-agent Deep Reinforcement Learning br

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Delay-Aware and Link-Quality-Aware Geographical Routing Protocol for UANET via Dueling Deep Q-Network

A DQN-Based Fair Coexistence Scheme for NR-U and WiGig in Unlicensed Mmwave Bands