Abstract:To accommodate the explosive wireless traffics, massive multiple-input multiple-output (MIMO) is regarded as one of the key enabling technologies for next-generation communication systems. In massive MIMO cellular networks, coordinated beamforming (CBF), which jointly designs the beamformers of multiple base stations (BSs), is an efficient method to enhance the network performance. In this paper, we investigate the sum rate maximization problem in a massive MIMO mobile cellular network, where in each cell a multi-antenna BS serves multiple mobile users simultaneously via downlink beamforming. Although existing optimization-based CBF algorithms can provide near-optimal solutions, they require realtime and global channel state information (CSI), in addition to their high computation complexity. It is almost impossible to apply them in practical wireless networks, especially highly dynamic mobile cellular networks. Motivated by this, we propose a deep reinforcement learning based distributed dynamic coordinated beamforming (DDCBF) framework, which enables each BS to determine the beamformers with only local CSI and some historical information from other BSs.Besides, the beamformers can be calculated with a considerably lower computational complexity by exploiting neural networks and expert knowledge, i.e., a solution structure observed from the iterative procedure of the weighted minimum mean square error (WMMSE) algorithm. Moreover, we provide extensive numerical simulations to validate the effectiveness of the proposed DRL-based approach. With lower computational complexity and less required information, the results show that the proposed approach can achieve comparable performance to the centralized iterative optimization algorithms.

Intelligent Passive Eavesdropping in Massive MIMO-OFDM Systems via Reinforcement Learning

Proactive Eavesdropping in Massive MIMO-OFDM Systems via Deep Reinforcement Learning

Angular-Domain Selective Channel Tracking and Doppler Compensation for High-Mobility Mmwave Massive MIMO

M-Net: A Lightweight Network Based on Multilayer Perceptron for Massive MIMO CSI Feedback

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Deep Reinforcement Learning for Multi-user Massive MIMO with Channel Aging

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

Joint QoS-Aware Scheduling and Precoding for Massive MIMO Systems via Deep Reinforcement Learning

Wireless Surveillance in a MIMO System with Spoofing Relay and UAV-enabled Eavesdropper

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

Spectrum-efficient user grouping and resource allocation based on deep reinforcement learning for mmWave massive MIMO-NOMA systems

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Weak Target Detection in Massive MIMO Radar via an Improved Reinforcement Learning Approach

Resisting Malicious Eavesdropping: Physical Layer Security of mmWave MIMO Communications in Presence of Random Blockage

Deep Learning Based Joint Beamforming Design in IRS-Assisted Secure Communications

Dynamic Unsourced Random Access with Massive MIMO

Multi-Intelligent Reflecting Surfaces and Artificial Noise-Assisted Cell-Free Massive MIMO Against Simultaneous Jamming and Eavesdropping

Fast MIMO Beamforming via Deep Reinforcement Learning for High Mobility mmWave Connectivity

Deep Reinforcement Learning-Enabled Secure Visible Light Communication Against Eavesdropping