Abstract:To accommodate the explosive wireless traffics, massive multiple-input multiple-output (MIMO) is regarded as one of the key enabling technologies for next-generation communication systems. In massive MIMO cellular networks, coordinated beamforming (CBF), which jointly designs the beamformers of multiple base stations (BSs), is an efficient method to enhance the network performance. In this paper, we investigate the sum rate maximization problem in a massive MIMO mobile cellular network, where in each cell a multi-antenna BS serves multiple mobile users simultaneously via downlink beamforming. Although existing optimization-based CBF algorithms can provide near-optimal solutions, they require realtime and global channel state information (CSI), in addition to their high computation complexity. It is almost impossible to apply them in practical wireless networks, especially highly dynamic mobile cellular networks. Motivated by this, we propose a deep reinforcement learning based distributed dynamic coordinated beamforming (DDCBF) framework, which enables each BS to determine the beamformers with only local CSI and some historical information from other BSs.Besides, the beamformers can be calculated with a considerably lower computational complexity by exploiting neural networks and expert knowledge, i.e., a solution structure observed from the iterative procedure of the weighted minimum mean square error (WMMSE) algorithm. Moreover, we provide extensive numerical simulations to validate the effectiveness of the proposed DRL-based approach. With lower computational complexity and less required information, the results show that the proposed approach can achieve comparable performance to the centralized iterative optimization algorithms.

Deep Reinforcement Learning for Joint Beamwidth and Power Optimization in Mmwave Systems

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Enhancing Mmwave Beam Prediction Through Deep Learning with Sub-6 GHz Channel Estimate

Reinforcement Learning for Beam Pattern Design in Millimeter Wave and Massive MIMO Systems

Deep Learning for Mmwave Beam-Management: State-of-the-Art, Opportunities and Challenges

Millimeter-Wave Networking in the Sky: A Machine Learning and Mean Field Game Approach for Joint Beamforming and Beam-Steering

Intelligent flying-beamformer for hybrid mmWave systems: A deep reinforcement learning approach

Self-Attention DDPG for Multi-Beam Combining in Mmwave MIMO Systems.

Efficient Initial Access with Deep Reinforcement Learning Based Beam Sweeping in Wireless Cellular Communication Systems

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

Robust mmWave Beamforming by Self-Supervised Hybrid Deep Learning

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Deep Learning for Beam-Management: State-of-the-Art, Opportunities and Challenges

Deep Learning and Image Super-Resolution-Guided Beam and Power Allocation for mmWave Networks

Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Deep Reinforcement Learning for mmWave Initial Beam Alignment

Deep Learning for Hybrid Beamforming with Finite Feedback in GSM Aided mmWave MIMO Systems