Distributed Adaptive Multiuser Scheduling Via Multi-Agent Reinforcement Learning in Multicell MIMO Cellular Networks

Shaozhuang Bai,Zhenzhen Gao,Xuewen Liao,Xiaodong Sun

DOI: https://doi.org/10.1109/vtc2024-spring62846.2024.10683472

2024-01-01

Abstract:In multicell cellular networks, coordinated multiuser scheduling (CMUS) based on block diagonalization precoding, which jointly selects the scheduled users among multiple base stations (BSs), is an efficient method to eliminate inter-user interference. However, most existing CMUS algorithms require global channel state information and many iterations, which are impractical in dynamic wireless networks due to its heavy information overhead and computational complexity. In this paper, we propose a distributed adaptive CMUS algorithm based on multi-agent reinforcement learning (MARL) to maximize the sum rate with less information overhead and computational complexity. In the proposed scheme, an adaptive multiple Deep Q-Network (DQN) architecture is deployed at each BS, aiming to reduce information overhead and computation complexity by identifying suitable CMUS policies with fewer DQNs. Each BS trains its own multi-DQNs and performs appropriate CMUS actions based on local information. Simulation results show that, by executing a subset of the DQNs, the proposed adaptive multi- DQN architecture reduces at least 50% of the information overhead and the computational complexity of the scheme without adaptive multi-DQN architecture. Additionally, compared to the centralized iterative approach, the proposed scheme costs 9.44% of the information overhead and 3.33%0 of the running time of the centralized iterative approach while achieving marginally superior performance.