Abstract:To accommodate the explosive wireless traffics, massive multiple-input multiple-output (MIMO) is regarded as one of the key enabling technologies for next-generation communication systems. In massive MIMO cellular networks, coordinated beamforming (CBF), which jointly designs the beamformers of multiple base stations (BSs), is an efficient method to enhance the network performance. In this paper, we investigate the sum rate maximization problem in a massive MIMO mobile cellular network, where in each cell a multi-antenna BS serves multiple mobile users simultaneously via downlink beamforming. Although existing optimization-based CBF algorithms can provide near-optimal solutions, they require realtime and global channel state information (CSI), in addition to their high computation complexity. It is almost impossible to apply them in practical wireless networks, especially highly dynamic mobile cellular networks. Motivated by this, we propose a deep reinforcement learning based distributed dynamic coordinated beamforming (DDCBF) framework, which enables each BS to determine the beamformers with only local CSI and some historical information from other BSs.Besides, the beamformers can be calculated with a considerably lower computational complexity by exploiting neural networks and expert knowledge, i.e., a solution structure observed from the iterative procedure of the weighted minimum mean square error (WMMSE) algorithm. Moreover, we provide extensive numerical simulations to validate the effectiveness of the proposed DRL-based approach. With lower computational complexity and less required information, the results show that the proposed approach can achieve comparable performance to the centralized iterative optimization algorithms.

Unsupervised Deep Learning for Power Control of Cell-Free Massive MIMO Systems

Deep Learning-based Power Control for Cell-Free Massive MIMO Networks

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Delay-Aware Power Control for Downlink Multi-User MIMO Via Constrained Deep Reinforcement Learning.

Deep reinforcement learning based joint cooperation clustering and downlink power control for cell-free massive MIMO

Double-Layer Power Control for Mobile Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Energy-efficient access point clustering and power allocation in cell-free massive MIMO networks: a hierarchical deep reinforcement learning approach

Energy-Delay-Aware Power Control for Reliable Transmission of Dynamic Cell-Free Massive MIMO

Uplink Power Control for Extremely Large-Scale MIMO with Multi-Agent Reinforcement Learning and Fuzzy Logic

Multicell Power Control under QoS Requirements with CNet

Sparse Power Control for Downlink Cell-Free Massive MIMO Systems with Limited Backhaul Capacities.

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

Joint Deep Reinforcement Learning and Unsupervised Learning for Channel Selection and Power Control in D2D Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Dynamic Resource Allocation in Co-Located and Cell-Free Massive MIMO

Joint User Association and Power Control for Cell-Free Massive MIMO

A Deep Learning Approach for User-Centric Clustering in Cell-Free Massive MIMO Systems

Energy-Efficient Power Control in Cell-Free and User-Centric Massive MIMO at Millimeter Wave

Distributed Learning for Uplink Cell-Free Massive MIMO Networks