Abstract:To accommodate the explosive wireless traffics, massive multiple-input multiple-output (MIMO) is regarded as one of the key enabling technologies for next-generation communication systems. In massive MIMO cellular networks, coordinated beamforming (CBF), which jointly designs the beamformers of multiple base stations (BSs), is an efficient method to enhance the network performance. In this paper, we investigate the sum rate maximization problem in a massive MIMO mobile cellular network, where in each cell a multi-antenna BS serves multiple mobile users simultaneously via downlink beamforming. Although existing optimization-based CBF algorithms can provide near-optimal solutions, they require realtime and global channel state information (CSI), in addition to their high computation complexity. It is almost impossible to apply them in practical wireless networks, especially highly dynamic mobile cellular networks. Motivated by this, we propose a deep reinforcement learning based distributed dynamic coordinated beamforming (DDCBF) framework, which enables each BS to determine the beamformers with only local CSI and some historical information from other BSs.Besides, the beamformers can be calculated with a considerably lower computational complexity by exploiting neural networks and expert knowledge, i.e., a solution structure observed from the iterative procedure of the weighted minimum mean square error (WMMSE) algorithm. Moreover, we provide extensive numerical simulations to validate the effectiveness of the proposed DRL-based approach. With lower computational complexity and less required information, the results show that the proposed approach can achieve comparable performance to the centralized iterative optimization algorithms.

Joint Beamforming and Power Control for MIMO-NOMA with Deep Reinforcement Learning

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Delay-Aware Power Control for Downlink Multi-User MIMO Via Constrained Deep Reinforcement Learning.

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Spectrum-efficient user grouping and resource allocation based on deep reinforcement learning for mmWave massive MIMO-NOMA systems

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Multi-user Massive MIMO with Channel Aging

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

Deep reinforcement learning based joint cooperation clustering and downlink power control for cell-free massive MIMO

Fast MIMO Beamforming via Deep Reinforcement Learning for High Mobility mmWave Connectivity

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

Deep Reinforcement Learning Based Power Allocation for Minimizing AoI and Energy Consumption in MIMO-NOMA IoT Systems

Joint QoS-Aware Scheduling and Precoding for Massive MIMO Systems via Deep Reinforcement Learning

A Deep Reinforcement Learning based Approach for NOMA-based Random Access Network with Truncated Channel Inversion Power Control

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Joint Optimization Framework for User Clustering, Downlink Beamforming, and Power Allocation in MIMO NOMA Systems

Self-attention reinforcement learning for multi-beam combining in mmWave 3D-MIMO systems

Absorption-edge singularities for a nonequilibrium Fermi sea. III. Determinantal nonperturbative theory.