Abstract:In this study, we examine the problem of downlink wireless routing in integrated access backhaul (IAB) networks involving fiber-connected base stations, wireless base stations, and multiple users. Physical constraints prevent the use of a central controller, leaving base stations with limited access to real-time network conditions. These networks operate in a time-slotted regime, where base stations monitor network conditions and forward packets accordingly. Our objective is to maximize the arrival ratio of packets, while simultaneously minimizing their latency. To accomplish this, we formulate this problem as a multi-agent partially observed Markov Decision Process (POMDP). Moreover, we develop an algorithm that uses Multi-Agent Reinforcement Learning (MARL) combined with Advantage Actor Critic (A2C) to derive a joint routing policy on a distributed basis. Due to the importance of packet destinations for successful routing decisions, we utilize information about similar destinations as a basis for selecting specific-destination routing decisions. For portraying the similarity between those destinations, we rely on their relational base-station associations, i.e., which base station they are currently connected to. Therefore, the algorithm is referred to as Relational Advantage Actor Critic (Relational A2C). To the best of our knowledge, this is the first work that optimizes routing strategy for IAB networks. Further, we present three types of training paradigms for this algorithm in order to provide flexibility in terms of its performance and throughput. Through numerical experiments with different network scenarios, Relational A2C algorithms were demonstrated to be capable of achieving near-centralized performance even though they operate in a decentralized manner in the network of interest. Based on the results of those experiments, we compare Relational A2C to other reinforcement learning algorithms, like Q-Routing and Hybrid Routing. This comparison illustrates that solving the joint optimization problem increases network efficiency and reduces selfish agent behavior.

On Traffic Routing in Network Powered by Computing Environment: ECMP vs. UCMP vs. Multi-Agent MAROH

On fair traffic allocation and efficient utilization of network resources based on MARL

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

Multi-Agent Reinforcement Learning for Network Load Balancing in Data Center

Network Clustering-Based Multi-Agent Reinforcement Learning for Large-Scale Traffic Signal Control

Multi-agent reinforcement learning for network routing in integrated access backhaul networks

MATE: when Multi-Agent Deep Reinforcement Learning Meets Traffic Engineering in Multi-Domain Networks

MA-CC: Cross-Layer Congestion Control via Multi-agent Reinforcement Learning

Multiagent Meta-Reinforcement Learning for Adaptive Multipath Routing Optimization

A Multi-agent Reinforcement Learning Perspective on Distributed Traffic Engineering

Cooperative Multi-Agent Actor–critic Control of Traffic Network Flow Based on Edge Computing

Feudal Multi-Agent Reinforcement Learning with Adaptive Network Partition for Traffic Signal Control

Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control

A Cooperative Multi-Agent Reinforcement Learning Framework for Resource Balancing in Complex Logistics Network

Integrating independent and centralized multi-agent reinforcement learning for traffic signal network optimization

DeepCC: Multi-Agent Deep Reinforcement Learning Congestion Control for Multi-Path TCP Based on Self-Attention

Decentralized Deep Reinforcement Learning for Network Level Traffic Signal Control

MACC: Cross-Layer Multi-Agent Congestion Control with Deep Reinforcement Learning

Combining multi-agent deep deterministic policy gradient and rerouting technique to improve traffic network performance under mixed traffic conditions

Computational Offloading for MEC Networks with Energy Harvesting: A Hierarchical Multi-Agent Reinforcement Learning Approach

Combat Urban Congestion via Collaboration: Heterogeneous GNN-based MARL for Coordinated Platooning and Traffic Signal Control